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MAINTENANCE  TRAINING  AND  AIDING: 

AN  OVERVIEW 

Dr.  William  J.  King  &  Dr.  Paul  E.  Van  Hemel^ 

Naval  Training  Equipment  Center 
Orlando,  Florida 


A  BREACH 

In  the  overview  of  an  earlier 
conference  in  this  series,  King 
(1975)  proclaimed  what  was  then  a 
"surprising"  discovery  that  there  was 
very  little  exchange  between 
developers/proponents  of  maintenance 
training  and  their  counterparts  in 
maintenance  aiding.  It  remained 
until  this  Third  Biennial  Conference 
for  us  to  call  a  meeting  devoted 
exclusively  to  discussing  that 
schism,  and  for  us  to  realize  that 
these  two  areas  of  maintenance 
support  have  for  several  years  been 
developing  along  separate  paths. 

The  dichotomy  is  real  I  This  was 
confirmed  by  at  least  two  prominent 
authors  among  those  of  the  present 
conference  papers  who  describe 
several  indications  of  potentially 
serious  impediments  to  the 
achievement  of  an  overall  integrated 
human  factors  effort.  Inaba  points 
out,  for  example,  the  mutual  distrust 
between  training  researchers  and 
aiding  researchers  and  that  human 
factors  researchers  and  human  factors 
practitioners  have  for  years  stood  as 
breeds  apart  in  terms  of  their 
approaches  and  solutions  to 
maintenance  problems.  Blanchard 
cites  material  by  Melton  dating  back 
to  1962  acknowledging  that 
"psychotechnologies  associated  with 
personnel  selection,  training,  and 
human  engineering  were  developed  more 
or  less  in  isolation  from  one 
another."  Further,  Blanchard  notes 
that  specialists  tend  to  promote 
their  own  parochial  interests  rather 
than  an  integration  of  concepts. 

^Both  are  now  at  Ergonomics 
Associates,  Inc.,  Orlando,  Florida. 


ATTEMPTED  HEALINGS  OF  THE  BREACH 

In  his  talk  at  the  conference, 
Dr.  Blanchard  presented  Figure  1  as 
an  Integrated  Personnel  System  Ap¬ 
proach  (IPSA)  to  improve  maintenance 
training  through  trade-offs  among  the 
depicted  elements.  The  concept  is, 
of  course,  very  reminiscent  of  the 
Personnel  Subsystem  approach  devel¬ 
oped  by  the  Air  Force  in  the  1960's 
to  integrate  Human  engineering, 
Training,  and  Personnel  Management. 
Just  as  Personnel  Subsystem  elements 
may  fall  into  natural  groupings 
(DeGreene,  1970),  elements  of  IPSA 
might  also  be  grouped  to  reflect: 

(a)  the  types  of  technologies  that 
fall  in  the  same  professional  cate¬ 
gory  in  the  human  factors  field,  and 

(b)  roles  of  current  Navy  commands. 

A  natural  grouping  might  allow  a 
concept  such  as  that  presented  in 
Figure  2,  which  represents  a 
simplified  approach  that  could  be 
implemented  and  working  in  the 
current  Navy  research  community 
within  a  very  short  period  of  time. 
The  approach  of  Figure  2  is  workable 
in  the  sense  that  there  exist  Navy 
research  organizations  with  expertise 
and  experience  to  permit  ready 
assumption  of  primary  responsibility 
for  the  design  research  groupings  of 
the  figure.  For  example,  the  Naval 
Air  Development  Center  is  well-versed 
in  Human  Engineering  Design  of  Air 
Systems,  the  Naval  Training  Equipment 
Center  knows  Training  and  Aiding 
System  Design,  and  the  Navy  Personnel 
Research  and  Development  Center  is 
certainly  expert  in  Personnel 
Pipeline  Design.  The  overall 
integration  function  could  be  served 
by  an  appropriate  organization  in  the 
Naval  Materiel  Command. 
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INTEGRATED  PERSONNEL  SYSTEM  A  REROACH  IRS*  . 


JOINT  CONSIDERATION  THROUGH  TRADE-OFF  ANALYSIS 


FIGURE  1.  Integrated  Personnel  System  Approach 
presented  by  Blanchard. 
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The  Integrated  Personnel  System 
Design  of  Figure  2  is  presented  here 
solely  as  a  working  level  suggestion 
for  one  way  of  improving  the  lot  of 
the  Navy  technician.  The  suggestion 
must  obviously  be  weighed  against 
other  requirements  which  are  beyond 
the  scope  of  this  conference  and 
certainly  that  of  the  present  paper. 
In  any  event,  as  Blanchard  notes,  the 
case  for  a  systems  approach  is 
compelling;  indeed,  we  may  be  able  to 
foster  such  an  orientation  by  taking 
advantage  of  such  natural  clusters  of 
interest  and  experience  as  those 
suggested  in  Figure  2. 

DECENTRALIZATION  OF  TECHNICAL 
TRAINING 

Two  papers  from  distinctly 
different  sources  sounded  an 
interesting  de-integration  theme, 
viz.,  technical  training  needs  to  be 
decentralized  to  on-the-job  training 
(OJT).  Carpenter-Huf fman  of  Rand 
Corporation  pointed  out  some  of  the 
limitations  of  formal  training  in 
schools  and  advocated  that 
maintenance  OJT  be  formally 
administered  by  operating  commands 
within  units  separated  from 
maintenance  production,  such  as  the 
Navy's  FRAMP  (Fleet  Readiness 
Aviation  Maintenance  Personnel). 
Klesch  of  the  Army  Training  Support 
Center  described  the  advantages  of 
the  Army's  Skill  Performance  Aids 
program  to  support  on-the-job 
training  and  job  performance  through 
improved  technical  manuals  and 
extension  training  materials. 

Decentralization  is  a  laudable 
approach  to  relieving  the  almost 
unmanageable  technical  training 
burden  within  DoD.  However,  unless 
we  can  provide  appropriate  delivery 
systems  such  as  adaptive  self-paced 
instructional  media,  there  will  be  a 
repeat  of  the  problem  underlined  in 
Carpen ter-Huf fman  '  s  paper,  to  wit, 
"The  most  common  single  complaint 
about  OJT  on  the  TAC  questionnaire 
was  that  those  assigned  as  trainers 
were  inadequate  as  teachers." 
(Carpenter-Huffman,  pg.  13)  With 


appropriate  delivery  systems,  the 
teaching  skill  of  the  individual 
responsible  for  technical  training  lr. 
the  fleet/field  is  not  such  a 
limiting  factor.  In  other  words, 
profess ionally-prepared  materials 
delivered  via  professionally-produced 
media  should  be  effective  for 
training  regardless  of  who  ultimately 
turns  on  the  power  switch. 

A  TECHNOLOGY  BASE  FOR  MT&A 

That  a  powerful  technology  base 
is  available  for  training  and  aiding 
the  technician  is  illustrated  by  tne 
conference  papers  of  Frazier,  DePaul, 
&  Towne.  In  endorsing  such 
approaches,  we  must  always  be  mindful 
of  the  rather  low  current  standing  of 
CAI  (Computer  Assisted  Instruction) 
in  the  military  community. 
Unfortunately,  it  does  little  good  to 
point  out  that  the  first  users  of 
fire  undoubtedly  learned  the  hard  way 
about  the  dangers  of  CO  poisoning  and 
asphyxiation.  The  point  is  that  CAI 
and  other  forms  of  computer  based 
instruction  could  be  a  boon  to 
technician  training  and  aiding  the 
world  over  if  we  can  Just  be  allowed 
to  bring  the  potential  solution  to 
bear  on  the  problem. 

AN  OMB  109  SOLUTION 

Other  themes  discussed  at  the 
conference  had  to  do  with  management 
solutions  for  getting  MTAA  delivered 
to  the  technician.  It  is  no 
surprise,  of  course,  that  management 
issues  would  arise  at  a  conference 
where,  even  on  the  last  day,  there 
were  no  fewer  than  23  Ph.D.s  in 
attendance.  What  was  interesting  was 
the  theme  that  "nobody  is 
implementing  our  technology"  and  that 
some  rather  innovative  solutions  were 
proposed . 

One  was  to  the  effect  that  since 
OMB  109  specifies  that  requirements 
be  articulated  by  government  and 
solutions  be  proposed  by  industry, 
why  not  just  abandon  all  our  feeble 
attempts  at  internal  technical 
training  by  the  military  and  contract 
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out  all  of  it?  Or  further,  why  not 
even  let  industry  recruit  and  select 
the  large  numbers  of  technical  troops 
to  fill  the  skilled  jobs  that  go 
begging  in  the  military? 

Such  topics  and  discussion  are 
presented  here  only  as  unexplored 
questions.  They  would  require 
analysis  and  could  serve  as  themes 
for  entire  MT&A  conferences  in  the 
future. 
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TECHNICIAN  TRAINING  AND  AIDING: 
WHERE  THE  DEFENSE  READINESS  BUCK  STOPS 

Dr.  Paul  E.  Van  Hamel 
Naval  Training  Equipment  Center 
Orlando,  Florida 


ABSTRACT 

Tne  outstanding  capability  of  U.S.  industrial  contractors  has  produced  revolu¬ 
tionary  developments,  new  subsystems,  and  sophisticated  design  in  weapons  systems 
and  other  equipments  to  meet  demanding  military  requirements.  The  result  has  often 
been  overly  complex  and  expensive  systems  that  leave  much  to  be  desired  in  the  way 
of  reliability.  The  sophistication  of  U.S.  weapons  systems  has  tended  to  generate 
higner  maintenance  personnel  and  training  costs  and  higher  support  costs;  it  has  also 
made  the  use  of  such  remedies  as  Automatic  Test  Equipment  (ATE)  mandatory  in 
many  maintenance  systems.  The  proliferation  of  increasingly  sophisticated  equipment 
on  which  readiness  depends  has  increased  further  the  need  of  highly  capable  mainte¬ 
nance  personnel.  The  readiness  of  our  defense  depends  on  what  may  be  thought  of  as 
the  "readiness"  of  maintenance  technicians,  namely,  the  availability  of  maintenance 
personnel  who  can  return  a  malfunctioning  system  to  the  operational  state.  The 
availability  of  such  personnel  is  directly  dependent  upon  our  capability  to  train  them 
and  to  provide  them  with  timely  and  convenient  access  to  technical  data.  Defense 
readiness  thus  ultimately  hinges  upon  effective  training  and  aiding  of  maintenance 
technicians. 


The  systems  on  which  people  depend  for  various  ne¬ 
cessities  have  become  more  complex  with  advances  in  tech¬ 
nology.  Not  surprisingly,  military  systems  provide  a  prime 
example  of  the  trend  of  increasing  complexity.  One  of  the 
most  striking  measures  of  that  trend  is  cost,  although 
otner  measures  are  certainly  possible.  Gates,  Gourary, 
Deitcnman,  Rowan,  and  Weimer  (1974)  used  cost  as  a 
measure,  presenting  data  illustrating  increasing  complexity 
over  seven  decades  as  reflected  in  costs.  Figure  1  shows  the 
cost  of  several  military  aircraft  as  a  function  of  year  of 
introduction.  From  the  figure,  it  is  evident  that  combat 
aircraft  costs  have  grown  steadily  over  the  years  following 
1910 

If  cost  measures  alone  do  not  convince  you  that 
today's  military  aircraft  are  more  complex  than  those  of 
earlier  years,  it  may  be  of  interest  to  examine  what  hap 
pened  to  aviation  electronics  during  the  period  from  1950 
to  the  early  1970's  when  miniaturization  was  shrinking 
electronics'  size  and  cost  almost  daily.  During  that  period, 
the  weight  of  electronics  carried  by  attack  and  intercepter 
aircraft  actually  increased  severalfold  and  the  cost  of  elec¬ 
tronics  rose  from  about  10-20  percent  of  total  aircraft  cost 
m  the  1950's  to  20-30  percent  in  the  late  1960'sand  early 
1970's  (Gates,  et  al..  1974). 

The  increase  in  complexity  of  systems  is  reflective 
of  American  creativity  and  fascination  with  new  tech¬ 


nology.  In  a  recent  analysis  of  technology  and  the  military 
balance.  Head  (1978)  contrasted  the  U.S.  Research  and 
Development  (R&D)  style  with  that  on  the  Soviet  side 
Head  characterized  the  effect  R&D  has  on  our  competitive 
market  economy  in  a  way  that  at  first  inspires  confidence, 
especially  when  compared  to  the  Soviet  system.  U.S.  in 
dustrial  producers  draw  upon  a  superior  technology  base, 
conduct  civil  and  military  R&D  simultaneously,  and  satisfy 
a  high  civil  demand  for  advanced  technology  products.  The 
American  R&D  process  is  more  fragmented  than  its  Soviet 
counterpart,  more  open  to  citizen  influences,  more  respon 
sive  to  arguments  over  arms  controls  implications,  environ 
mental  impact,  and  a  fair  allocation  of  government  con 
tracts.  Yet,  the  U.S.  system  operates  amazingly  well  be¬ 
cause  of  the  skills,  flexibility  and  ingenuity  of  its  scientists, 
engineers,  and  technicians  (Head,  1978). 

Weapons  development  in  the  U.S.  is  oriented  toward 
high  performance,  largely  as  a  result  of  the  responsiveness 
of  our  R&D  to  demanding  military  requirements.  U.S.  in¬ 
dustrial  contractors  respond  to  those  requirements  with 
proposals  for  revolutionary  developments,  new  subsys 
terns,  and  sophisticated  design  (Head,  1978),  and  the  cycle 
of  increasing  complexity  continues.  In  the  Soviet  system, 
proscription  of  all  but  centrally-approved  designers'  hand 
books,  lack  of  sophistication  in  production  technology, 
low  technical  level  of  Soviet  troops,  and  other  limitations 
provide  seemingly  reassuring  constraints  on  their  weapons 
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YEAR  OF  INTRODUCTION 

FIGURE  1.  Cost  of  Indicated  Military  Aircraft 
as  a  Function  of  the  Year  of  Introduction 
(Adapted  from  Gates,  et  al.,  1974) 

design. 

In  my  comparison  of  U  S.  and  Soviet  R&O  styles,  I 
have  implied  that  the  superiority  of  the  U.S.  system  may 
be  more  apparent  than  real.  You  might  reasonably  expect 
to  find  a  relationship  between  complexity  of  weapons  sys¬ 
tems  and  military  capability,  but  the  relationship  you  ex¬ 
pect  may  not  be  the  one  that  actually  exists.  Head  (1978) 
warned  that  superficial  comparisons  between  supposedly 
equivalent  U.S.  and  Soviet  weapons  systems  can  delude 
policy  make/s  into  thinking  that  "technological  superior¬ 
ity"  guarantees  peace.  Head  was  concerned  that  at  some 
point  greater  quantity  of  lower-quality  weapons  confers 
the  capability  to  overwhelm  the  highest  quality  defense.  I 
think  there  is  more  cause  for  concern  that  one  may  be 
lulled  into  thinking  that  complexity  of  weapons  systems 
guarantees  technological  superiority. 

Let  us  examine  the  relationship  between  system  com¬ 
plexity  and  system  reliability  using  cost  as  an  index  of 
complexity.  Figure  2  shows  field  reliability  as  a  function 
of  unit  production  cost.  Clearly,  as  system  cost  and  associ¬ 
ated  complexity  increase,  reliability  decreases  (Gates, 
et.  al..  1974).  The  relationship  is  not  perfect,  but  the  trend 
is  obvious.  With  the  exception  of  equipment  maintained 
under  warranty,  the  highest  reliability  shown  in  the  figure 
is  for  the  $372  51 Z3  Marker  8eacon,  and  the  lowest  relia¬ 
bility  is  for  the  $312,000  AWG-10  Radar  and  Fire  Control. 
Gates,  et  al.  (1974)  noted  improved  reliability  under  spe¬ 
cial  programs,  such  as  maintenance  under  warranty  by  the 


contractor  for  the  Delco  Carousel  IV  inertial  navigator, 
and  argue  that  such  programs  can  promise  alleviation  of 
the  reliability  problems.  At  the  same  time,  they  point  out 
that  an  annual  15  percent  rate  of  growth  in  reliability  ot 
electronics  as  technology  advances  is  barely  keeping  pace 
with  the  rate  at  which  the  complexity  of  weapons  system 
electronics  is  increasing,  so  that  the  electronics  subsystem 
reliability  trend  has  been  stationary  or  downward  (Gates, 
et  al.,  1974). 


FIGURE  2.  Field  Reliability  as  a  Function  of 
Unit  Production  Cost.  R,  WL,  and  WF  indicated 
special  reliability  program.  (Adapted  from 
Gates,  et  al.,  1974) 

If  you  accept  that  there  is  a  direct  relationship  be 
tween  system  cost  and  weight,  it  will  not  surprise  you  that 
reliability  also  decreases  as  weight  increases.  Figure  3 
shows  some  data  presented  by  the  Naval  Weapons  Engi¬ 
neering  Support  Activity  (1978).  It  will  be  interesting  to 
see  how  the  F-18  reliability  actually  delivered  operation 
ally  compares  with  that  promised  by  the  contract  require¬ 
ment.  If  you  would  like  to  try  predicting  which  of  the  two 
points  plotted  for  the  F-18  is  likely  to  come  closer  to  what 
really  happens,  Figure  4  may  help  you.  Figure  4  shows 
promised  and  actually  achieved  reliability  for  several  tacti¬ 
cal  airborne  radars,  and  in  every  case  the  operationally  de 
livered  mean-time-between-failures  did  not  live  up  to  the 
specification  (Pyatt,  1972). 

The  point  of  emphasizing  the  reliability  problems 
with  complex  systems  is  the  obvious  implication  for  over 
all  support  costs,  and  maintenance  in  particular.  When  a 
complex  system  breaks  down,  maintenance  comes  into 
play  and  the  longer  the  maintenance  time  required,  the  less 
time  the  system  is  available  to  perform  its  intended  func 
tion.  Readiness  thus  depends  directly  on  the  maintenance 
function.  The  sophistication  of  systems  has  required  so 
phisticated  approaches  to  maintenance,  such  as  the  use  of 
Automatic  Test  Equipment  (ATE). 
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FIGURE  3.  Field  Reliability  of  Indicated  Aircraft 
as  a  Function  of  Weight.  (Adapted  from  A  Prediction 
of  Aviation  Logistics  Requirements,  NAVWESA,  1978) 
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FIGURE  4,  Reliability  promised  in  the 
specifications  and  operational  reliability  actually 
delivered  for  several  tactical  airborne  radar  systems. 
(Adapted  from  Pyatt,  1972) 


VAST  and  peculiar  ground  support  equipmr 
avionics  have  shown  that  VAST  reduces  m».f:ten«-  ■ 
sonnel  time  and  elapsed  maintenance  time  (V,  es  ^  - 
However,  original  predictions  about  training  tu  v  ~ 
have  not  been  realized.  Myles  (1978i  descriDed  n*  ;  • 
lems  succinctly  (P.  21): 

The  original  concept  ol  VAST  enviS'Liue  : 
use  of  an  operator  with  minimal  tram  r  g  ’>1 
cept  has  been  shown  lacking  because  .t  a  tit  , ■ 
situation  in  which  the  program  wi i i  t>e  uefV  ■ 
machine  will  always  operate  proper  y,  anc  Jil  . 
tation  associated  with  the  testing  process  w.i  »■*>*, 
be  up-to-date  and  correct.  Experience  has  show 
all  of  these  factors  seldom  prevail  in  spite  oi  me  .. 
stringent  efforts.  .  .The  assumptions  originally  rr„i:. 
concerning  the  VAST  maintenance  technic  is-  a  s 
suffered  from  the  same  inaccuracies  as  with  the  ,.r 
ator.  .  .this  technician  required  more  training  a- ■: 
perience  to  effectively  troubleshoot  the  com ;  •  . 
VAST  system. 

VAST  training  was  expanded  in  response  to  the  prop  —  - 
Myles  described.  More  recently,  VAST  training  was  rr  . 
ified  again,  to  include  a  course  to  produce  a  new  urn,-  • 
VAST  technician,  the  Test  Program  Set  Analyst,  a"/:  ■ 
expand  still  further  the  maintenance  courses  (Van  ~,i-r  - 
1978).  The  point  is  that  even  though  the  support  harawa' 
for  complex  and  sophisticated  systems  may  mater  r  os. 
systems  in  sophistication,  maintenance  still  is  ultimate  . 
dependent  on  people. 

My  argument  so  far  is  Simply  that  defense  rtau.-‘  s 
depends  upon  the  availability  of  maintenance  pers.  "•  i 
who  can  return  a  malfunctioning  system  to  the  operat  o"a 
state.  There  is  nothing  really  new  in  such  an  argument 
point  was  forcefully  made  more  than  fifteen  year'  ago  b , 
Morgan,  Cook,  Chapanis,  and  Lund  (1963,  P.  374; 

Equipment  that  requires  skill  levels  higher  ••  a 
those  that  can  be  made  available  cannot  De  mam:  • 
ed  successfully.  In  fact  if  the  maintenance-ski  .  i-. 
required  is  much  in  excess  of  that  available  re¬ 
equipment  can  be  a  liability  rather  than  an  osse1 


The  proliferation  of  increasingly  sophisticated  equ.pm. 
is  pushing  us  toward  ever  higher  skill-level  requirement' 
which  can  only  have  an  adverse  impact  on  defense  ••m  - 
mess. 


The  use  of  ATE  has  resulted  in  savings  in  costs,  space, 
and  resources,  but  at  the  expense  of  an  upgrading  in  tech¬ 
nician  training  (King  and  Duva,  1978).  A  notabie  instance 
uf  increased  need  for  sophisticated  maintenance  personnel 
as  a  result  ot  ATE  use  is  given  by  the  Versatile  Avionics 
Shop  Test  (VAST)  system.  VAST  is  a  large  and  complex 
general-purpose,  computer-controlled  test  system  used  by 
the  intermediate  and  depot  level  maintenance  activities  to 
rest  and  fault  isolate  avionics  equipment  from  several 
Naval  aircraft  Studies  comparing  avionic  support  by 


The  availability  of  maintenance  persorme.  who  La- 
return  a  malfunctioning  system  to  the  operations:  slat- 
may  be  thought  of  as  maintenance  technician  read. "ess 
The  readiness  of  a  technician  to  perform  as  intended  *• 
certainly  depend  upon  several  factors,  including  long  ter.- 
ones  such  as  the  quality  of  personnel  available  for  mam:.- 
nance  and  support  activities,  and  short  term  ones  suer  as 
moment-to-moment  fluctuations  in  the  technician's  atte' 
tion.  Among  the  most  important  determiners  of  techmcia- 
readiness  are  the  subjects  of  this  conference,  training  anc 
aiding.  Some  of  the  papers  presented  here  sound  the  theme 
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that  training  is  the  critical  element,  whereas  other*  argue  Human  Factors  Laboratory.  Naval  Training  Equipment 

that  with  adequate  aiding  to  provide  the  technician  with  Center,  Orlando,  Florida  in  1977. 

the  needed  information,  training  may  be  de-emphasized. 

I  look  forward  to  finding  out  whether  an  approach  com¬ 
bining  the  two  may  be  the  solution.  Regardless,  improved 
defense  readiness  is  ultimately  dependent  on  the  readiness 
of  technicians,  and  that  in  turn  means  personnel  who  have 
the  information  they  need  when  they  need  it,  and  the  skill 
to  apply  it. 
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MAINTENANCE  TRAINER  VS  FLIGHT  TRAINER  PROCUREMENT: 
SOME  STRIKING  DISSIMILARITIES 

Robert  G.  Kinkade,  Ph.D. 

Esaax  Corporation,  Sen  Diego  Facility 
San  Diego,  California 


ABSTRACT 

This  paper  compares  the  procurement  of  maintenance  and  flight  trainers  in  the 
Navy  and  reports  preliminary  results  evaluating  the  use  of  a  maintenance  trainer  in  an 
advanced  technician  training  course.  Procurement  of  flight  trainers  is  a  carefully  con¬ 
trolled  procedure  that  begins  early  in  aircraft  acquisition  processes  and  is  focused  on 
developing  the  skills  needed  to  operate  a  new  or  modified  aircraft.  But  the  Navy  does 
not  typically  procure  maintenance  trainers.  Usually,  technician  training  Is  considered 
late  in  the  RDT&E  acquisition  process  and  not  at  all  during  the  Modification  acquisi¬ 
tion  proccess.  Results  of  pilot  testing  on  an  experimental  technical  training  course 
indicate  that  substantial  dollar  savings  could  be  obtained  from  applying  a  coherent, 
disciplined  approach  to  course  design.  The  purpose  of  this  paper  is  to  focus  attention 
on  the  benefits  that  could  be  obtained  by  applying  Maintenance  Instructional  Tech¬ 
nology  (MIT)  to  the  procurement  of  technician  training  systems. 


INTRODUCTION 

The  Department  of  Defense  has  emphasized  using 
bight  simulation  training  devices  for  training  pilots  and 
otner  aircrew  personnel  (Cream,  Eggemeier,  and  Klein, 
1978).  However,  the  use  of  maintenance  training  simula¬ 
tion  devices  for  training  technicians  is  not  emphasized.  In 
fact,  the  use  of  actual  equipments  for  technician  training  is 
encouraged.  As  a  result,  the  services  are  not  taking  advan¬ 
tage  of  known  methods  for  increasing  training  effective¬ 
ness  and  reducing  training  costs. 

The  prime  cost  of  military  system  ownership  is  the 
maintenance  personnel  subsystem.  There  are  approximate 
ly  240,000  full  time  technicians  in  each  service,  and  it 
costs  some  $5  billion  per  year  to  have  these  technicians  on 
the  job.  With  regard  to  training,  about  one-fourth  of  these 
technicians  are  new  to  the  services  each  year  and  it  costs 
approximately  SI  . 2  billion  per  year  per  service  to  support 
these  technicians  while  they  are  being  trained  (Shriver, 
19751.  The  services  simply  cannot  afford  to  continue  ig 
normg  proven  methods  for  increasing  technican  training 
effectiveness  and  reducing  training  costs. 

This  paper  compares  the  procurement  of  flight  and 
maintenance  trainers  in  the  Navy  and  reports  preliminary 
results  evaluating  the  use  of  a  maintenance  trainer  in  an 
advanced  technician  training  course.  The  purpose  of  the 
paper  is  to  focus  attention  on  the  benefits  that  could  be 
obtained  by  the  services  from  applying  Maintenance  In¬ 
structional  Technology  (MIT)  to  the  procurement  of  tech¬ 
nician  training  systems. 


FLIGHT  AND  MAINTENANCE 
TRAINER  PROCUREMENT 

Relative  Number  of  Navy  Flight  and  Maintenance  Trainers 

Trainer  devices  supported  by  NTEC  are  described  in 
the  Directory  of  Naval  Training  Devices.  Over  70%  of  the 
roughly  300  trainer  devices  described  in  this  Directory 
(Sections  1 ,  2,  and  4)  support  aircrew  training,  25%  sup 
port  other  operator  training,  and  less  than  5%  are  useq 
exclusively  to  support  technician  training.  Of  those  train 
ers  used  to  support  technician  training,  most  are  two-di¬ 
mensional  displays  of  system  schematics,  or  "cutaway" 
models  of  system  equipments.  Very  few  provide  for 
"hands-on"  practice  of  technician  tasks  and  these  almost 
exclusively  involve  stimulation  of  actual  system  equip 
ments. 

Flight  Trainer  Procurement 

During  the  procurement  of  new  or  modified  aircraft, 
there  are  stated  requirements  for  the  application  of  in 
structional  technology  (MIL-T-29053,  1977).  From  the 
beginning,  flight  training  requirements  are  based  on  anal 
yses  of  pilot  tasks  that  are  required  to  operate  the  new  air¬ 
craft  under  a  variety  of  mission  conditions.  Pilot  aids,  de 
signed  to  unburden  the  pilot  during  the  performance  o' 
some  of  these  tasks,  are  systematically  identified.  For  re 
maining  tasks,  knowledge  and  skill  learning  objectives  are 
specifically  identified  and  sequenced  in  a  coordinated, 
comprehensive  fashion.  A  broad,  integrated  range  of  media 
is  used  to  achieve  these  learning  objectives.  Lectures  and 
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individualized  instruction  are  supported  by  audio  visual 
and  text  materials  to  achieve  knowledge  objectives.  These 
materials  are  designed  and  developed  by  contractors  who 
are  experienced  in  the  development  of  training  programs. 
Fur  skill  learning  obiectives,  a  family  of  flight  trainers  is 
acquired.  This  group  of  devices  permits  progressive  devel¬ 
opment  of  pilot  skills.  That  is,  the  pilot  begins  with  funda¬ 
mental,  generalizable  skills  and  progresses  to  complex,  sys¬ 
tem-specific  skills,  including  team  skills  in  some  cases.  Fi¬ 
nally,  since  procurement  of  flight  trainer  devices  is  initi¬ 
ated  very  early  in  the  acquisition  process,  they  are  deliv¬ 
ered,  and  can  be  evaulated,  at  the  same  time  the  newly 
developed  aircraft  undergoes  Operational  Test  and  Evalu¬ 
ation  (OPNAVINST,  1974,  Feuge  and  Lankford,  19761. 


quirements,  along  with  operator  training  requirements,  are 
documented  in  the  Navy  Training  Plan  (OPNAVINST, 
1975).  The  costs  for  satisfying  unique  training  require 
ments  must  be  budgeted  for  by  the  Program  Manager  of 
the  development. 

For  modified  weapon  systems,  technician  training  re 
quirements  are  identified  by  technician-instructors,  who 
have  received  little  or  no  training  in  the  use  of  instruc 
tional  technology  methods.  These  technician-instructors 
are  concerned  with  altering  existing  curricula  rather  than 
conducting  a  task  analysis  of  the  modified  system.  As  a 
result,  inadequacies  in  existing  curricula  are  not  usually 
addressed. 


All  of  these  procurement  practices  assure  safe,  effec¬ 
tive,  and  efficient  pilot  training.  Trained  pilots  are  avail¬ 
able  when  they  are  needed  to  fly  newly  developed  or 
modified  aircraft,  because  experienced  pilots  are  transi¬ 
tioned  to  the  new  aircraft  while  initial  training  is  provided 
to  novice  pilots.  And,  once  developed,  pilot  skills  are  not 
allowed  to  deteriorate  through  disuse,  because  refresher 
training  is  provided  as  part  of  the  flight  training  program 
design. 

In  summary,  procurement  of  flight  trainers  is  a  care¬ 
fully  controlled  process  that  begins  early  in  aircraft  acqui¬ 
sition  processes  and  is  focused  on  developing  the  skills 
needed  to  operate  a  new  or  modified  aircraft.  Flight 
trainers  are  considered  an  essential  part  of  the  overall  flight 
training  system.  The  procurement  of  flight  training  sys¬ 
tems  is  supported  by  Directives,  Instructions,  anti  MiL 
Standards. 

Maintenance  Trainer  Procurement 

During  the  acquisition  of  a  new  or  modified  weapon 
system,  there  are  no  requirements  to  separately  address 
technician  training.  Technician  training  is  considered  along 
with  operator  training  in  existing  acquisition  processes. 


Once  technician  training  requirements  are  identified, 
a  restricted  range  of  media  is  generally  used  to  satisfy  these 
requirements.  Typically,  technician  training  courses  de 
pend  on  lectures  supported  by  technical  manuals.  For  new 
weapon  systems,  these  lectures  are  developed  by  Navy 
technician-instructors  who  have  been  introduced  to  the 
new  system  by  the  prime  contractor  (OPNAVINST,  1973) 
Actual  equipments  are  frequently  used  by  the  contractor 
to  train  the  initial  group  of  technician-instructors.  The 
contractor's  usual  inexperience  in  training  program  devel 
opment  also  results  in  initial  technician-instructor  training 
materials  that  are  prepared  largely  by  design  engineers. 
Finally,  the  prime  contractor  is  often  funded  to  support 
the  new  system  until  the  Navy  can  maintain  it.  Therefore, 
it  is  really  not  advantageous  to  the  contractor  to  provide 
comprehensive  training  program  development.  These  mate 
rials  require  more  sophisticated  reading  skills  than  most 
student  technicians  possess.  Further,  little  concern  for 
head /book  trade-off  issues  (Joyce,  1975)  is  reflected  in 
these  materials. 

As  a  result,  initial  technician  training  courses  are  not 
usually  comprehensive  nor  are  they  supported  by  carefully 
selected  media. 


Typically,  technician  training  requirements  are  not 
identified  in  the  RDT&E  acquisition  process  until  the 
,  weapon  system  is  in  the  Full-Scale  Development  phase. 

But  at  this  point,  it  is  too  late  to  make  trade-off  decisions 
affecting  technician  training  efficiency  and  effectiveness 

[since  over  95%  of  the  system  life-cycle  costs  are  commit¬ 
ted  (HARDMAN,  1977)  and,  for  Modification  acquisition, 

I  technician  training  requirements  are  usually  ignored  until 

deficiencies  in  maintenance  performance  are  recognized. 
This  realization  occurs  after  the  modifications  have  been 
^  implemented  and  the  system  is  not  properly  maintained. 

f 

Identification  of  technician  training  requirements  for 
■  new  weapon  systems  is  not  usually  based  on  analyses  of 

]  tasks.  Rather,  technician  training  requirements  are  based 

S  on  subjective  assessments  of  differences  between  the  new 

I  system  and  existing,  similar  systems.  If  the  system  under 

f  development  is  judged  to  be  significantly  different  from 

existing  systems,  new  training  requirements  may  be  identi¬ 
fied.  Otherwise,  existing  technician  training  courses  are 
1  presumed  to  be  adequate.  These  technician  training  re- 


Maintenance  trainer  devices  used  for  developing  tech 
nician  skills  have  only  -seemly  been  considerea  by  the 
Navy  (Brock,  1978,  a).  Where  the  requirement  lor  prac 
ticing  technician  skilis  is  recognized,  actual  equipments  are 
frequently  used.  In  fact,  it  is  Navy  policy  to  provide  actual 
equipments  for  training  purposes  (OPNAVINST,  1971). 
Actual  equipments  are  used  even  when  the  cost  of  such 
equipments  far  exceed  the  cost  of  maintenance  trainers 
that  could  be  designed  for  effective  technician  training. 

The  cost  benefits  of  using  maintenance  trainers  com 
pared  to  actual  equipments  are  well  documented  For  in 
stance,  Daniels  and  Cronin  (1975)  estimate  a  $2.4  million 
dollar  savings  in  the  acquisition  cost  of  a  simulator  over 
one  suite  of  an  actual  electronics  system.  A  comparison 
of  the  life  cycle  costs  of  the  two  systems  resulted  in  an 
additional  savings  of  $1.3  million.  In  another  study.  Miller 
and  Rockway  (1975)  found  that  the  cost  of  two  sets  of 
actual  equipment  exceeded  $980,000,  while  two  complete 
simulation  packets  were  available  for  slightly  under 
$170,000. 
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In  addition,  the  use  of  actual  equipments  for  techni¬ 
cian  training  has  some  serious  deficiencies.  These  equip 
ments  cannot  be  programmed  for  a  variety  of  faults,  they 
may  be  hazardous  to  users,  they  do  not  provide  technician 
performance  measures,  and  they  are  not  "student-proof." 
As  a  result,  it  is  impossible  to  design  a  logical  progression 
of  skill  development,  student  practice  must  be  monitored 
constantly  to  avoid  injury  and  provide  subjective  assess 
ments  of  performance,  and  substantial  resources  are  re¬ 
quired  to  maintain  the  equipments  used  by  students.  Addi¬ 
tionally,  it  is  often  difficult  to  update  these  equipments  to 
reflect  alterations  to  systems  in  the  fleet  These  equip 
ments  are  not  usually  available  for  training  purposes  until 
long  after  the  newly  developed  system  has  been  operation 
ally  deployed  and,  by  that  time,  training  curricula  have 
been  developed  without  the  equipments.  In  these  cases, 
use  of  equipments  for  skill  development  is  "tacked  on"  at 
the  end  of  the  course. 

Maintenance  team  skills  are  not  addressed  in  most 
technician  training  courses  because  for  the  most  part, 
technician  training  courses  are  rating  specific.  When  two 
or  more  technicians  with  different  ratings  are  required  to 
perform  maintenance  tasks  together,  they  must  learn  team 
skills  on  the  job.  Maintenance  trainers  that  permit  the  de¬ 
velopment  of  the  team  skills  in  a  controlled  training  situa¬ 
tion  are  rarely,  if  ever,  considered. 

Technician  training  programs  are  developed  to  pro¬ 
vide  initial  training,  but  transition  and  refresher  training 
are  usually  not  considered  at  the  time  of  course  develop¬ 
ment.  Presently,  for  example,  a  Boiler  Technician  who  has 
been  assigned  to  a  600  psi  ship  may  be  assigned  to  a  1200 
psi  ship  with  no  transition  training  at  all. 

In  summary,  the  Navy  does  not  typically  procure 
maintenance  trainers.  Usually,  technician  training  is  con¬ 
sidered  late  in  the  RDT&E  acquisition  process  and  not  at 


all  during  the  Modification  acquisition  process  Technician 
training  relies  heavily  on  lectures  supported  by  technical 
manuals.  Where  the  need  for  skill  development  is  recog 
nized,  actual  equipments  are  usually  used  The  procure 
ment  of  technician  training  systems  is  not  supported  by 
Directives,  Instructions,  or  MIL  Standards  that  separately 
address  technical  training. 

MAINTENANCE  TRAINER  EVALUATION 
Background 

Automatic  Boiler  Control  (ABC)  systems  are  used  to 
control  processes  that  produce  the  steam  needed  to  oper 
ate  ship  propulsion,  electrical  generation,  and  auxiliary 
equipments  aboard  ship.  Proper  functioning  of  the  ABC 
systems  is  essential  for  accomplishing  the  ship's  mission 
However,  the  Director  of  the  Steam  Propulsion  Improve 
ment  Project  recently  reported,  "Many  ships  have  been 
unable  to  satisfactorily  accomplish  boiler  flexibility  tests 
without  requesting  outside  assistance.  A  contributing  fac 
tor  to  this  situation  is  the  general  lack  of  knowledge  and 
fault  analysis  capability  of  ABC  maintenance  technicians" 
(Greer,  1978).  A  research  project  was  undertaken  to  ex 
plore  ways  of  correcting  this  situation  for  Hagan  ABC 
technicians. 

Official  Course  Description 

The  official  course  used  to  train  Hagan  ABC  mainte¬ 
nance  technicians  is  a  stand  up  lecture,  limited  media 
course.  Groups  of  about  15  students  progress  through  the 
course  during  a  five  week  period.  Students  practice  com 
ponent  disassembly,  inspection,  reassembly,  and  calibra 
tion  tasks  using  actual  components,  following  demonstra 
tions  performed  by  instructors.  In  addition,  they  practice 
diagnosing  the  causes  of  several  casualty  conditions  in 
serted  by  an  instructor  using  a  Pneumatic  Maintenance 
Simulator  (Shown  in  Figure  1).  This  simulator  consists  of 
actual  ABC  system  components  that  are  stimulated  by 


FIGURE  1.  Pneumatic  Maintenance  Simulator 
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pneumatic  and  electrical  signals.  The  causes  of  casualty 
conditions  are  diagnosed  from  symptoms  displayed  on 
gauges  contained  in  a  Boiler  Console  replica.  An  instructor 
must  be  present  to  provide  feedback  regarding  the  cause  of 
the  casualty  condition  he  inserted.  The  acquisition  cost  of 
the  two  Pneumatic  Maintenance  Simulators  used  in  this 
course  is  reported  to  be  $360,000  and  the  annual  mainte¬ 
nance  cost  is  reported  to  be  $35,000  to  $50,000  (Swezey, 
1978). 

Experimental  Course  Description 

An  experimental  course  was  developed  to  train  Hagan 
ABC  system  maintenance  technicians.  This  course  uses  an 
individualized,  self-paced,  mixed-media  approach.  Students 
achieve  knowledge  learning  objectives  using  text  and 
audio-visual  programs.  Skill  learning  objectives  are 
achieved  using  actual  components  and  a  maintenance 
trainer,  called  a  Fault  Identification  Simulator  (FIS).  A 
FIS  is  shown  in  Figure  2. 


an  incorrect  diagnosis.  If  two  incorrect  “repair"  actions 
are  taken,  the  FIS  advises  the  student  to  contact  hit  Learn¬ 
ing  Center  Supervisor.  Finally  a  backlighted  schematic  of 
the  ABC  system  is  provided  to  help  students  conceptualize 
system  dynamics  during  troubleshooting  skill  develop¬ 
ment.  The  acquisition  cost  of  three  FIS  devices  is  reported 
to  be  $111,000,  and  the  annual  maintenance  cost  it  re¬ 
ported  to  be  less  than  $5,000  (Swezey,  1978). 

Preliminary  Evaluation  Results 

The  experimental  course  was  pilot  tested  at  the  Fleet 
Training  Center,  San  Diego.  Student  completion  times  are 
shown  in  Figure  3.  This  figure  shows  that  the  16  students 
in  the  course  completed  the  course,  on  the  average,  in  ap¬ 
proximately  two-and-a-half  weeks.  The  slowest  completion 
time  was  just  over  three  weeks,  and  the  fastest  completion 
time  was  just  under  two  weeks.  These  completion  times 
were  achieved  even  though  training  objectives  associated 
with  troubleshooting  skill  development  were  added  to 


FIGURE  2.  Fault  Identification  Simulator  (FIS) 


Students  practice  component  disassembly,  inspection, 
reassembly,  and  calibration  tasks  using  actual  components 
along  with  Job  Sheets  describing  how  to  perform  step-by- 
step  procedures.  Students  may  take  these  Job  Sheets  with 
them  when  they  graduate  from  the  course  and,  thus,  they 
become  performance  aids. 

Three  FIS  devices  were  provided  in  the  experimental 
course.  Each  FIS  is  capable  of  displaying  the  symptoms  of 
23  different  fault  conditions  on  a  Boiler  Console  replica. 
All  fault  conditions  resulting  from  a  single  component  fail¬ 
ure  in  the  actual  system  can  be  represented  in  a  FIS.  In 
addition,  students  can  interrogate  the  FIS  and  receive  the 
information  about  system  component  measures,  that  they 
would  obtain  in  the  actual  system.  Students  can  “repair" 
any  of  the  system  components  and  observe  the  conse 
quences  of  their  actions.  If  they  elect  to  "repair"  a  com 
ponent  that  is  not  faulty,  the  FIS  immediately  indicates 


FIGURE  3.  Student  Course  Completion  Times 
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those  contained  in  the  official  course.  Contrasted  to  the 
conventional  course  completion  time  of  five  weeks,  these 
figures  represent  a  considerable  increase  in  efficiency. 

If  the  experimental  course  were  officially  imple¬ 
mented,  and  students  were  given  flexible  detailing  to  the 
school,  a  minimum  savings  of  180  man  weeks,  almost 
three-and  a  half  man  years,  could  be  realized.  The  yearly 
pay  of  a  typical  Hagan  technician  is  $14,819.  Therefore, 
the  savings  of  three-and-a-half  man  years  is  nearly  $52,000 
(Brock,  1978, b).  Since  the  same  course  is  also  taught  at 
the  Fleet  Training  Center,  Norfolk,  over  $100,000  per  year 
could  be  saved  in  technician  pay  by  adopting  the  experi¬ 
mental  course  and  providing  flexible  detailing  to  the 
schools. 

In  addition,  since  the  FIS  uses  a  pr ogammable  micro¬ 
computer,  fault  condition  symptoms  can  be  economically 
changed  to  reflect  modifications  to  the  Hagan  ABC  sys¬ 
tem.  This  is  important  because  experience  suggests  that 
SHIPALTS  which  should  be  incorporated  in  maintenance 
trainers  occur  about  once  every  two  years.  Presently,  the 
Pneumatic  Maintenance  Simulators  used  in  the  official 
course  will  be  modified  to  reflect  recent  SHIPALTS.  The 
cost  of  making  these  changes  for  the  four  devices  in 
San  Diego  and  Norfolk  is  estimated  to  be  $100,000.  The 
cost  of  modifying  the  FIS  programs  is  estimated  to  be 
$20,000. 

Total  savings  to  the  Navy,  if  a  technician  course  like 
the  experimental  Hagan  ABC  Maintenance  Course  were 
adopted,  are  dramatic.  For  this  one  course,  over  a  ten  year 
period,  about  $1  million  could  be  saved  in  technician  pay, 
$600,000  could  be  saved  in  maintenance  cost,  and 
$400,000  could  be  saved  in  making  modifications  to  the 
maintenance  trainers,  for  a  total  savings  of  $2  million. 

More  importantly,  however,  technicians  would  be 
given  an  opportunity  to  develop  those  troubleshooting 
skills  needed  to  isolate  faults  aboard  ship.  A  simulation 
maintenance  trainer  can  be  used  to  represent  a  comprehen¬ 
sive  range  of  fault  conditions  and  provide  immediate 
knowledge  of  results  as  well  as  student  performance  mea¬ 
sures.  As  a  result,  the  fault  analysis  capability  of  graduate 
technicians  is  upgraded.  This  kinu  of  training  has  a  direct 
and  obvious  impact  on  syste  n  availability. 
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ABSTRACT 

A  set  of  guidelines  for  maintenance  OJT  to  improve  its  effectiveness.  Effective 
OJT  is  essential  to  mission  support;  improved  OJT  effectiveness  is  needed  in  many  spe¬ 
cialties  because  of  the  greater  demands  placed  on  maintenance  personnel  by  advanced 
technology  and  because  of  the  greater  diversity  of  equipment  and  duty  stations  in 
today's  military  environment.  Deficiencies  in  current  OJT  programs  arise  from  the 
nature  of  the  working  environment  and  from  disincentives  that  encourage  only  super¬ 
ficial  adherence  to  the  services'  policies  for  OJT.  The  content,  resources,  and  manage¬ 
ment  of  preferred  approaches  to  OJT  are  described.  In  particular,  formalized  conduct 
of  OJT  by  separate  units  within  the  operating  commands  is  advocated.  Successful  OJT 
programs  that  have  followed  this  approach  are  described  as  evidence  of  their  practi¬ 
cality  and  utility. 


INTRODUCTION 

In  peacetime,  training  is  one  of  the  main  purposes 
for  the  conduct  of  military  operations.  Although  the  re¬ 
sources  required  to  support  operational  training  activities 
are  not  budgeted  for  training,  as  such,  clearly  their  cost  is 
far  greater  than  the  cost  of  formal  training.  Moreover,  the 
training  given  in  operating  units  is  essential  for  maintain¬ 
ing  readiness.  In  many  specialties  readiness  can  be  more 
significantly  improved  by  improving  the  effectiveness  of 
operational  training  than  by  improving  training  in  tech¬ 
nical  schools. 

Effective  OJT  also  alleviates  problems  of  local  man¬ 
agement  by  assuring  supervisors  that  people  are  capable 
of  performing  tasks  for  which  they  have  been  "signed 
off,"  thereby  supplying  identifiable  groups  of  compe¬ 
tent  workers. 

The  portion  of  OJT  that  qualifies  people  to  perform 
tasks  is  the  link  between  school  training  and  performance 
on  the  job.  Therefore,  improvements  in  this  aspect  of 
OJT  can  also  lead  to  increased  efficiency  in  school  training 
by  better  identifying  its  content  or  by  decreasing  the  need 
for  school  training  in  specific  tasks. 

The  effectiveness  of  OJT  for  task  performance  has 
become  more  important  in  recent  years  for  several  rea¬ 
sons.  One  is  the  increased  technological  sophistication  of 
military  equipment  and  systems,  which  places  greater  de¬ 


mands  on  maintenance  personnel.  Even  systems  that  have 
been  designed  to  minimize  demands  for  maintenance  in 
the  field  often  require  special  skills  that  are  inadequately 
taught  in  an  introductory  course.  [1]  Another  reason  is 
the  diversity  and  proliferation  of  systems  in  the  field. 
For  example,  in  the  division  forces  of  the  Army  there  are 
now  about  0.71  items  of  major  equipment  for  every  sol¬ 
dier. 

Although  school  training  can  give  people  a  general 
preparation  to  cope  with  this  environment,  it  is  difficult 
for  school  training  to  qualify  the  graduate  for  job  per¬ 
formance.  For  one  thing,  actual  job  conditions  often 
are  not  duplicated  in  school  training.  Moreover,  so  many 
variations  in  the  working  environment  are  possible  that 
attempts  to  duplicate  all  possibilities  would  make  train¬ 
ing  excessively  expensive. 

McLarty,  an  instructor  in  the  Armor  school  at  Fort 
Knox,  graphically  describes  the  situation  for  the  turret 
mechanic  specialty; 

(In  formal  training).  .  .the  student  learns  his  skill 
within  a  classroom  and  laboratory  environment.  .  .  . 
All  manuals,  tools,  and  test  equipment  required  to 
diagnose  and  repair  faults  are  readily  available.  A 
skilled  instructor,  along  with  a  group  of  peers,  is  avail¬ 
able  to  render  advice  and  assistance,.  .  .  In  the  field. 


[1]  See,  for  example,  Carpenter-Huffman  and  Rostker,  1975. 
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the  turret  mechanic  finds  that  maintenance,  instead 
of  being  the  primary  focus  of  each  day's  activities, 

is  now  ancillary  to  a  multitude  of  missions . 

Turret  trainers  and  reasonably  comfortable  laborato¬ 
ries  have  been  replaced  by  functioning  combat  vehi¬ 
cles  with  myriads  of  faults  and  shortcomings,  and  a 
motor  pool  or  trains  area  that  most  likely  is  exposed 
to  whatever  Mother  Nature  has  to  offer.  ...  He  may 
often  be  required  to  work  alone,  or  with  only  tank 
crewmembers  to  detect  and  correct  malfunctions. 
He  may  well  find  that  his  unit  is  short  tools  and  test 
equipment  that  were  readily  available  in  school. 
(McLarty.  1978,  p.  9). 

Beyond  what  may  be  relatively  minor  variations  in 
local  conditions,  we  have  already  mentioned  the  diversity 
of  tasks  with  which  the  service  person  may  be  faced  in  the 
field,  even  within  a  single  specialty.  In  the  Army,  for 
example, 

A  soldier  in  MOS  1 1 B 1  may  serve  in  anyone  of  33 
jobs  (duty  stations)  when  he  leaves  his  one-station 
unit  training  .  .  .  and  goes  to  a  unit ....  Before  he  is 
sent  to  his  unit,  the  11B1  soldier  is  currently  trained 
in  only  five  jobs  .  .  .  These  are  among  the  highest 
density  jobs,  so  the  odds  are  he  will  wind  up  in  one  of 
them.  But,  what  if  he  does  not?  Well,  he  must  then 
be  trained  on  the  job  by  his  supervisor. 


In  other  MOS  the  problem  is  one  of  difference  in 
equipment  as  compared  to  number  of  jobs.  An  artil¬ 
leryman  in  MOS  13B,  for  example,  may  work  with 
any  one  of  five  cannon  weapons  systems  when  he 
completes  his  entry  training  ...  he  is  trained  (only) 
on  the  most  prevalent,  the  self-propelled  155  Howit¬ 
zer.  M109E1.  (Department  of  the  Army,  pp.  3-1  and 
3-2). 

Similarly,  the  Air  Force  Ground  Radio  Equipment  Mainte¬ 
nance  career  field  (304X4)  encompasses  4  distinct  jobs  for 
first-term  airmen. 

Although  this  problem  may  partly  be  resolved  by  tai¬ 
loring  training  to  the  job  of  first  assignment  (resulting  in 
several  different  initial  courses  within  the  same  specialty), 
the  problem  remains  of  insuring  that  persons  have  the 
needed  skills  when  they  move  about  within  the  specialty 
(or  if  they  are  initially  misassigned)  and  when  they  up¬ 
grade. 

In  sum,  initial  training  in  formal  schools  will  rarely  be 
able  fully  to  qualify  maintenance  personnel  for  their  first 


jobs  because  job  performance  is  more  or  less  idiosyncratic 
to  the  work  environment.  In  addition,  OJT  will  always  be 
needed  for  upgrade  training,  to  refresh  skills  in  important 
tasks  that  are  rarely  or  never  performed  in  the  normal 
work  situation,  and  to  introduce  new  equipment  or  proce 
dures. 

People  in  the  field  often  view  properly  conducted 
OJT  as  the  most  effective  of  all  training  the  service  has 
given  them.  Although  this  view  may  partly  be  due  to  myo 
pia  (since  their  OJT  is  the  freshest  in  their  memories),  it  is 
true  that  OJT  teaches  job  performance  by  guided  practice, 
generally  considered  the  most  effective  method  of  teaching 
skills.  [1]  In  addition,  OJT  is  largely  generated  by  imme¬ 
diate  maintenance  needs,  which  helps  insure  its  relevance. 

In  what  follows  I  shall  present  evidence  of  present 
problems  in  OJT  and  discuss  their  underlying  causes.  These 
problems  are  not  found  in  all  maintenance  specialties,  but 
often  arise  in  those  in  which  maintenance  personnel  work 
under  difficult  conditions  or  are  under  production  pres 
sure.  Next,  I  shall  propose  a  general  approach  to  resolving 
these  problems  and  describe  instances  in  which  application 
of  similar  approaches  has  improved  OJT.  My  intent  is  to 
urge  fundamental  changes  in  the  management  of  OJT  and 
to  present  some  guidelines  for  improvements  in  OJT  for 
maintenance  specialties  in  each  service.  I  shall  not  deal 
with  aspects  of  OJT  such  as  correspondence  courses  that 
may  support,  but  do  not  directly  teach,  job  performance. 

DEFICIENCES  IN  CURRENT  OJT 

Several  years  ago  the  Tactical  Air  Command  (TAC) 
administered  a  questionnaire  at  all  operating  bases  where 
advanced  avionics  were  maintained,  as  part  of  an  effort  to 
improve  management  and  training  of  avionics  maintenance 
personnel.  [2)  This  questionnaire  included  open-ended 
questions  eliciting  respondents'  reactions  to  their  OJT 
Many  assessed  OJT  as  having  been  the  most  useful  of  all 
the  training  they  had  received.  Even  OJT-enthusiasts,  how 
ever,  often  noted  deficiencies  in  the  training  or  suggested 
improvements. 

A  recent  Rand  survey  of  personnel  skilled  in  mainte¬ 
nance  of  Army  land  vehicles  uncovered  similar  deficien 
cies.  [3]  Although  I  cite  specific  sources  of  evidence, 
however,  I  believe  the  deficiencies  observed  arise  to  a 
greater  or  lesser  extent  in  many  maintenance  OJT  situ 
at  ion. 

The  first  set  of  problems  is  caused  by  the  work  situa 
tion  and  the  way  the  trainee  is  managed  within  it.  Sched 
uled  and  unscheduled  maintenance  tasks  arise  in  response 
to  the  needs  of  the  operating  unit,  not  in  response  to  train- 


11  ]  For  a  description  of  respondents'  comments  on  formal  training,  see  Carpenter-Huffman  and  Rostker,  1975* 

(2]  See,  for  example.  Air  Training  Command,  1968  and  1970;  Pieper,  et.  al.  1870;  Taylor,  et.  al.,  1972;  Weingarten, 
et.  al„  1972. 

I3J  Documentation  of  the  survey  by  Harz,  part  of  the  Rand  Land  Vehicle  Maintenance  Study  for  the  Defense  Ad 
vanced  Research  Projects  Agency  (DARPA),  has  not  baen  released.  The  results,  however,  have  been  briefed  to  the  Army  as 
well  as  to  DARPA. 
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ing  requirements.  Thus,  the  trainee  may  have  more  than 
enough  chances  to  learn  one  task,  whereas  he  may  never  be 
exposeu  to  other  tasks  equally  necessary  for  journeyman 
qualification  In  the  words  of  one  airman  The  OJT  pro¬ 
gram  was  not  adequate  because  only  certain  areas  of  main 
o'nance  are  consistently  being  worked  on  at  this  particular 
(dir;  base  and  other  maintenance  in  other  systems  is  rare  or 
non  existent. 

The  vagaries  of  the  work  situation  are  exacerbated  by 
the  management  of  trainees.  Trainee  time  may  largely  be 
aosorbed  by  additional  on-site  training  unrelated  to  the  job 
(such  as  driver  education),  cleanup  and  other  routine  de¬ 
tails.  and  acting  as  a  go  fer.  Many  of  the  respondents  to  the 
TAC  questionnaire  complained  about  the  amount  of  time 
required  for  "ridiculous  squadron  and  barracks  details"  or 
about  not  being  allowed  to  work  on  the  aircraft.  Although 
some  of  these  complaints  may  have  represented  normal 
griping,  many  of  them  were  voiced  by  more  senior  person¬ 
nel  who  were  not  at  the  time  burdened  with  "ridiculous" 
details. 

Another  set  of  problems  arises  from  failure  to  en¬ 
hance  the  work  situation  with  resources  needed  specifi¬ 
cally  for  training.  The  most  important  of  these  is  a  person 
who  both  knows  and  can  teach  the  job  (a  trainer).  Sheer 
unavailability  of  trainers  was  noted  by  many  respondents 
to  the  TAC  questionnaire.  TAC  feels  its  problem  has 
worsened  during  the  last  few  years  in  this  regard  because 
of  a  marked  decrease  in  the  authorized  ratio  of  skilled  to 
unskilled  enlisted  personnel.  In  1973,  TAC  had  for  each 
person  witn  grade  E  l  through  E-3,  1.76  people  with  grade 
£  4  through  E  6.  The  corresponding  ratio  in  1978  was  1.04. 

The  Army  faces  similar  difficulties.  For  example, 
McLarty  noted  that  in  the  turret  mechanic  MOS: 

The  fact  is  that  we  haven't  really  had  a  qualified  tur¬ 
ret  mechanic  supervisor  in  most  units.  This  has  been 
largely  due  to  the  fact  that  the  organizational  turret 
mechanic  could  only  progress  through  grade  E5  in  his 
primary  MOS  ....  (McLarty,  1978,  p.  10). 

Even  when  the  unit  has  people  qualified  to  train 
cithers,  these  people  may  be  forced  by  production  de¬ 
mands  to  slight  their  training  responsibilities.  This  is  most 
likely  to  happen  in  specialties  closely  tied  to  mission  oper¬ 
ations,  such  as  flight  line  aircraft  maintenance. 

In  most  instances,  a  person  who  has  been  designated 
as  a  trainer  knows  enough  about  the  job  to  perform  it.  In 
some  cases,  however,  particularly  where  relatively  new 
equipment  is  involved,  even  the  designated  trainer  is  inade¬ 
quately  skilled,  either  because  he  has  been  pushed  up  the 
skill  ladder  without  comprehensive  OJT,  because  he  has 
no!  had  the  chance  to  become  familiar  with  the  equip- 
ment.  or  because  the  specialty  itself  has  newly  been  cre¬ 
ated.  One  Air  Force  staff  sergeant  stated  flatly  that: 

The  OJT  program  is  worthless.  OJT  trainers  did  not 
know  enough  about  equipment  to  be  trainers. 


Lack  of  t'amers  with  sufficient  job  performance  skills 
is  not  limited  tu  the  most  technologically  advanced  spe¬ 
cialties,  however.  The  Rand  survey  of  Army  land  vehicle 
maintenance  also  noted  that  supervisors  who  were  ex 
pected  to  tram  others  needed  much  more  thorough  experi¬ 
ence  in  each  of  the  different  maintenance  tasks -repair, 
ordering  parts,  and  completing  forms,  for  example. 

Finally,  even  when  enough  skilled  personnel  are  avail¬ 
able  to  provide  the  training  required,  persons  assigned  as 
trainers  may  be  poor  instructors.  It  is  unlikely  that  a  main 
tenance  journeyman  has  been  trained  to  teach,  nor  is  there 
reason  to  believe  that  he  has  natural  aptitude  as  a  teacher. 
In  addition,  the  over-riding  incentives  for  most  trainers  are 
to  do  the  work,  not  to  train  someone  else  to  do  it.  The 
most  common  single  complaint  about  OJT  on  the  TAC 
questionnaire  was  that  those  assigned  as  trainers  were  iiv 
adequate  as  teachers. 

Normal  operating  equipment  may  also  be  inadequate 
for  the  training  situation.  For  example,  on  the  flight  line 
trainers  often  need  such  minor  items  as  additional  head 
sets  for  instructing  trainees.  Thus,  in  addition  to  deficien¬ 
cies  in  the  availability  or  quality  of  instructors,  problems 
may  also  arise  from  the  lack  of  supplies  or  equipment 
needed  specifically  for  training.  Training  equipment  may 
be  particularly  useful  for  teaching  sophisticated  skills 
(such  as  troubleshooting)  or  performance  of  dangerous 
tasks. 

CAUSES  OF  OJT  DEFICIENCIES 

Each  of  the  services  has  established  procedures  for 
the  conduct  of  OJT  which,  if  they  could  be  fully  imple¬ 
mented,  would  help  provide  adequate  training.  In  fact, 
respondents  to  both  the  TAC  questionnaire  and  the  Rand 
questionnaire  urged  that  the  OJT  programs  that  exist  "on 
paper"  be  put  into  effect  to  remedy  training  problems 

Mere  exhortation  to  implement  existing  policy  is  un¬ 
likely  to  effect  more  than  superficial,  passing  change,  how¬ 
ever,  for  two  reasons.  First,  commanders  are  not  immedi 
ately  rewarded  for  the  quality  of  their  maintenance  activ¬ 
ities,  let  alone  their  maintenance  OJT  programs.  Instead, 
they  and  those  they  command  are  penalized  if  documen¬ 
tation  of  progress  in  OJT  does  not  conform  to  the  sched 
ule  set  for  it.  Second,  as  discussed  above,  for  many  spe¬ 
cialties  the  normal  work  environment,  in  which  OJT  is  to 
be  conducted,  is  not  conducive  to  effective  training. 

Let  me  expand  briefly  upon  the  problem  of  disincen¬ 
tives.  The  relative  remoteness  of  maintenance  activities 
from  primary  combat  missions  leads  to  widely  varying 
and  often  inadequate  emphasis  on  maintenance  by  man 
agers  and  supervisors.  In  Army  wheeled  vehicle  mainte¬ 
nance,  Harz  found  that  maintenance  officers  and  NCOs 
are  often  lacking  practical  experience  in  their  field.  Harz 
also  found  that  pressures  to  "come  in  as  Category  I"  on 
the  Operational  Readiness  report  often  destroy  the  valid 
ity  and  usefulness  of  vehicle  preventive  maintenance  and 
operational  readiness  records. 
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On  the  other  hand,  since  progress  in  OJT  is  tied  to 
the  promotion  system,  supervisors  are  under  pressure  to 
certify  a  person's  competence  whether  or  not  the  cer¬ 
tification  is  warranted.  For  example,  in  the  Air  Force  the 
supervisor  designates  for  each  person  the  skills  necessary 
his  qualification,  and  one  new  5-level  may  have  mastered 
many  job-related  tasks  while  another  may  have  mastered 
few  or  none.  Thus,  it  is  not  too  surprising  to  read  the 
comments  of  one  airman  that: 

After  6  months  you're  given  a  5-level  whether  you 
want  one  or  not.  Your  abilities  on  the  aircraft  don't 
matter  as  long  as  you  spent  6  months  on  this  base. 
Therefore,  there  are  many  5-levels  who  don't  know 
anything  more  about  the  aircraft  than  the  3-levels 
assigned  to  them  (as  trainees). 

Many  other  respondents  to  the  TAC  questionnaire  urged 
that  OJT  cease  being  dominated  by  requirements  for  skill 
upgrading. 

To  cope  with  a  similar  problem,  the  Army  is  replacing 
the  "MOS  tests"  with  Skill  Qualifying  Tests  (SQTs)  to  ver¬ 
ify  an  individual's  present  skill  level  and  to  qualify  him  for 
award  of  the  next  higher  skill  level. 

Soldiers  scoring  80  percent  or  above  on  theSQT  will 
form  a  pool  of  soldiers  who  are  qualified  for  award  of 
the  next  higher  skill  level.  Promotion  quotas  will  be 
filled  from  that  group  first  using  additional  criteria.  .  . 
(department  of  the  Army,  1  April  1977,  p.  4-5). 

Thus,  scores  on  the  SQTs  may  provide  sorely  needed  mea¬ 
sures  of  OJT  effectiveness. 

A  GENERAL  SOLUTION 

The  approach  I  advocate  is  a  formalization  of  the  task 
training  portion  of  OJT  within  the  operating  unit.  Below  I 
describe  the  content,  resources,  and  management  needed 
to  improve  OJT  in  those  specialties  in  which  it  is  currently 
deficient. 

Training  Content 

All  apprentices  should  master  a  set  of  skills  identi¬ 
fied  by  supervisors  who  are  both  concerned  with  and  in¬ 
formed  about  the  current  job.  These  are  the  skills  they  feel 
are  needed  by  a  competent  journeyman.  This  does  not 
mean  that  alj_  training  content  should  be  technical  in 
nature,  however.  Other  skills  needed  for  adequate  job  per¬ 
formance,  such  as  work  planning,  should  also  be  taught. 
(U.  S.  Department  of  Labor,  p.  20). 

On  the  other  hand,  often  when  training  is  given  in 
the  normal  work  environment,  the  trainer  fails  to  give 
adequate  explanations  of  how  or  why  a  particular  proce¬ 
dure  is  used:  that  is,  whereas  formal  training  may  over¬ 
emphasize  abstract  principles,  OJT  may  slight  them.  Some 
understanding  of  why  a  procedure  is  followed  not  only 
helps  the  trainee  cope  with  novel  situations  but  also  im¬ 
proves  motivation.  Probably  it  is  most  efficient  to  deter¬ 


mine  how  much  theoretical  background  is  useful  or  nec 
essary  to  support  an  individual's  performance  of  a  given 
task  during  instruction  of  that  individual  on  that  task. 

Unless  all  training  is  done  in  the  work  environment, 
special  provisions  are  needed  to  keep  the  content  of  train¬ 
ing  relevant  to  the  job.  This,  primarily  a  management  prob 
lem,  is  discussed  further  below. 

Training  Resources 

As  already  discussed,  maintenance  personnel  are  not 
usually  expert  instructors,  although  many  of  them  may 
empathize  with  the  student  and  communicate  well  with 
him,  as  a  good  instructor  must  do.  But  a  good  instructor 
also  must  be  able  to  schedule  teaching  situations  to  build 
on  what  the  trainee  already  knows,  arrange  problems  to 
highlight  new  learning  and  to  provide  practice  for  skills 
already  learned,  and  adjust  the  pace  of  training  to  the 
trainee's  needs  and  motivation.  Of  course,  a  good  instruc¬ 
tor  knows  the  subject  matter  well  enough  to  teach  it,  al¬ 
though  he  need  not  be  the  most  skilled  maintenance  per¬ 
son  in  his  specialty. 

As  with  any  skill,  both  aptitude  and  training  are 
needed  to  produce  a  good  instructor.  Ideally,  instruc¬ 
tors  should  receive  both  initial  training  and  OJT  in  how  to 
instruct.  (U.  S.  Department  of  Labor,  p.  22). 

At  least  part  of  task  training  must  be  conducted  on 
actual  equipment  in  a  close  approximation  of  the  working 
environment.  This  is  particularly  important  (and  difficult) 
for  maintenance  that  must  be  performed  under  difficult 
conditions,  such  as  out  of  doors  in  bad  weather  or  on 
equipment  that  is  hard  to  get  to.  Showing  trainees  how  to 
work  under  such  conditions  is  an  essential  part  of  training. 

Since  operational  equipment  may  not  present  suffi¬ 
cient  opportunities  for  learning  particular  tasks,  some  task 
training  may  need  to  be  conducted  outside  of  normal  oper 
ations.  Preventive  maintenance  can  sometimes  be  taught 
on  equipment  that  is  temporarily  not  needed  (on  the 
weekends,  for  example)  or  that  is  out  of  operation  for 
some  reason  that  will  not  interfere  with  the  training.  Each 
of  these  situations  introduces  problems  of  scheduling,  but 
a  determined  instructor  can  often  work  around  them. 

Bonafide  malfunctions  should  also  be  used  to  teach 
skills  in  unscheduled  maintenance.  Although  this  again 
puts  the  teaching  at  the  mercy  of  production  schedules, 
more  advanced  trainees  working  in  realistic  situations  will 
learn  about  production  pressure  as  they  practice  job  per¬ 
formance.  Before  they  reach  this  point,  however,  they 
need  to  have  mastered  tasks  performance  skills  in  struc 
tured  training  experiences. 

Maintenance  simulators,  just  now  coming  into  use, 
may  have  application  in  this  area;  I'm  sure  their  many 
advantages  will  be  fully  dealt  with  in  the  course  of  this 
conference.  I  would  like  to  make  two  points  in  this 
paper  -1)  the  utility  of  maintenance  simulators  should  be 
examined  for  OJT  as  well  as  for  school  training,  and  2) 
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because  the  trainee  needs  to  learn  to  do  his  job  in  the 
working  environment,  simulators  should  not  carry  the  en¬ 
tire  burden  of  task  training. 

Similarly,  facilities  for  OJT  should  include  a  mixture 
of  realistic  and  training-oriented  settings.  Much  of  training 
couid  take  place  in  a  laboratory-like  environment,  but  at 
least  some  of  it  should  be  conducted  in  an  actual  work  set¬ 
ting  or  a  reasonable  facsimile  of  one.  Realism  is  most  im¬ 
portant  for  specialties  in  which  working  conditions  can  be 
difficult,  as  mentioned  earlier.  "Field  trips"  should  be 
scheduled  both  to  observe  on-going  maintenance  and  to 
conduct  it  in  situ.  Field  training  sessions  might  be  sched¬ 
uled  for  off-days  or  in  special  areas  to  minimize  disruption 
of  regular  maintenance.  Instructors  could  "walk  trainees 
through"  a  job  from  beginning  to  end  and  familiarize  them 
with  the  activities  and  processes  that  generate  maintenance 
tasks  and  that  support  them  (e.g.  maintenance  control, 
supply  points,  and  quality  control).  Duren  has  urged  this 
type  of  training  for  flightline  avionics  maintenance. 
(Ouren,  1976,  p.  7). 

Ideally,  training  should  be  given  when  the  need  for 
it  arises  in  the  work  environment.  This  maximizes  the 
trainee's  opportunity  to  relate  what  he  is  learning  to  job 
performance  and  enhances  his  motivation  to  learn.  As 
suggested  earlier,  however,  production  pressure  can  over¬ 
ride  training  opportunities.  In  addition,  normal  work 
schedules  may  not  give  rise  to  training  opportunities  with 
the  frequency  needed.  Thus,  the  timing  of  training  needs 
to  be  closely  linked  to  but  not  dominated  by  the  work 
environment.  One  way  to  achieve  such  a  mix  is  for  the 
trainee  to  work  part  of  the  day  and  train  part  of  the  day. 

Training  Management 

The  first  question  is,  what  agency  should  administer 
the  approach  to  task  training  I  am  advocating?  Since  I 
have  emphasized  the  training  process -scheduling  of  teach 
mg  sequences,  competent  instructors,  equipment  designed 
for  training- ,  it  might  be  argued  that  an  organization 
whose  maior  mission  is  training  would  be  most  appro¬ 
priate. 

In  fact,  service  training  organizations  often  establish 
temporary  or  permanent  training  units  in  the  field;  some 
of  these  are  effective  in  bridging  the  gap  between  formal 
training  and  |0b  performance.  The  Field  Training  Detach¬ 
ments  (FTDsl  of  Air  Training  Command,  for  example, 
have  several  advantages  over  the  technical  schools  because 
of  their  proximity  to  the  workplace.  FTD  instructors  are 
better  able  to  maintain  relevant  course  content  because  it 
is  easier  for  them  to  visit  the  work  centers  to  observe  the 
latest  techniques  in  job  performance  and  to  find  out  what 
shop  supervisors  need  in  the  way  of  training.  Often  FTD 
instructors  have  had  considerable  experience  in  the  unit 
and  with  the  unit  equipment  and  can  draw  from  working 
expertise  in  their  teaching.  Training  equipment  used  at  the 
FTDs  is  more  realistic  than  that  at  technical  school,  and 


the  operating  unit  may  make  spares  available  to  keep  train 
mg  equipment  working  or  may  allow  FTD  instructors  to 
conduct  training  on  equipment  from  the  operating  inven¬ 
tory. 

Despite  its  proximity  to  the  workplace,  however, 
the  FTD  can  also  become  isolated  from  the  job.  In  avionics 
maintenance  training,  for  example,  FTD  instructors  and 
students  rarely  had  access  to  actual  aircraft  and  never  used 
real  malfunctions  as  opportunities  for  training.  In  fact,  the 
physical  demands  of  FTD  duty,  were  considerably  less 
than  those  of  the  flight  line,  and  opportunities  for  self 
direction  were  greater.  Thus,  people  assigned  to  FTD 
usually  wanted  to  remain  there,  and  it  took  an  aggressive 
and  hard-working  person  who  was  willing  to  put  in  extra 
hours  to  maintain  his  practical  expertise.  It  was  not  sur¬ 
prising  that  some  FTD  courses  were  strongly  supported 
by  the  user  others  were  condemned  as  irrelevant 
(Carpenter-Huffman  and  Rostker,  p.  76). 

It  is  difficult  to  satisfy  requirements  for  training  rel¬ 
evance  when  instructors  are  ultimately  responsible  to  a  rel¬ 
atively  remote  organization  whose  major  mission  is  train¬ 
ing.  If,  however,  the  training  is  administered  by  persons 
responsible  to  those  who  employ  their  students  (that  is, 
by  persons  assigned  to  the  operating  command),  incentives 
to  maintain  training  relevance  will  be  stronger.  Although  it 
may  be  difficult  to  keep  such  training  from  being  captured 
by  production  needs,  setting  aside  a  separate  activity  for 
maintenance  training  will  provide  better  protection  than 
does  the  usual  approach  to  OJT.  Thus,  I  am  advocating 
that  the  operating  commands  fulfill  their  current  respon¬ 
sibilities  for  maintenance  OJT  by  administering  it  formally 
within  units  separated  from  maintenance  production. 

The  Navy's  FRAMP  (Fleet  Readiness  Aviation  Main¬ 
tenance  Personnel)  units  appear  to  come  close  to  meeting 
the  specifications  I  have  been  discussing.  Their  mission  is 
to  train  enlisted  people  to  maintain  specific  aircraft.  Naval 
policy  dictates  that  maintenance  training  is  to  receive  the 
same  emphasis  as  pilot  training.  After  formal  schooling, 
practical  maintenance  training  is  conducted  on  fully  opera¬ 
tional  FRAMP  aircraft  and  supporting  equipment  dedi¬ 
cated  to  training  in  a  separate  facility.  Practical  training  is 
provided  by  qualified  petty  officers  within  the  appropriate 
maintenance  specialties.  This  is  followed  by  OJT  within 
the  operational  unit. 

The  FRAMP  may  be  the  best  solution  to  the  Navy's 
OJT  needs.  [  1 )  The  Air  Force  and  Army  have  a  more 
complex  problem  because  of  the  number  and  diversity  of 
their  units  in  the  field.  It  will  be  complicated  to  determine 
how  many  maintenance  training  organizations  are  needed 
for  each  specialty  or,  possibly,  for  combinations  of  spe¬ 
cialties  dealing  with  different  items  of  equipments  or  sys 
terns.  The  heterogeneity  of  the  specialty,  the  number  of 
people  within  it,  its  technical  complexity,  and  the  cost  of 


[  1  ]  Its  major  disadvantage  is  the  poor  approximation  it  provides  to  the  operational  environment. 
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different  configurations  would  all  have  to  be  considered. 
Quite  possibly,  not  every  operating  location  would  need 
such  an  organization;  rather,  some  training  might  be  con¬ 
centrated  at  a  few  locations. 

Such  a  unit  would  ease  the  transition  of  the  new  as¬ 
signee  from  formal  training  to  work  performance.  It  would 
also  provide  the  continuation  training  needed  for  people 
changing  duty  stations  or  equipment,  to  assure  continued 
job  proficiency,  to  prepare  people  for  upgrading,  and  to 
facilitate  adjustment  to  changes  in  technology  or  proce¬ 
dures.  (Department  of  Labor,  p.  21). 

I  have  already  suggested  the  importance  of  evaluation 
in  assuring  the  effectiveness  of  OJT.  The  Department  of 
the  Army  SQT  pamphlet  supplies  an  excellent  general  de¬ 
scription  of  procedures  that  should  be  used  for  such  an 
evaluation.  Should  the  separate  unit  for  training  administer 
such  evaluations?  The  answer  is  probably  "no"  (except  for 
interim  evaluations),  since  that  would  put  the  unit  in  the 
position  of  evaluating  its  own  product.  Thus,  it  would  be 
better  for  a  different  unit,  say  one  associated  with  mainte¬ 
nance  quality  control,  to  administer  definitive  evaluations 
of  OJT  trainees. 

It  is  unfortunate  that  upgrading  is  so  closely  tied  to 
certification  of  OJT  progress  that  progress  is  falsified  to 
satisfy  the  upgrade  schedule.  Such  falsification  obviously 
does  not  help  the  commander  assess  the  maintenance  capa¬ 
bilities  of  his  unit.  If  upgrading  is  as  automatic  as  some 
have  implied,  occurring  at  the  six-month  point  willy  nilly, 
OJT  could  be  decoupled  from  it  with  little  ill  effect.  Cer¬ 
tainly  patently  undesirable  persons  could  still  be  denied 
promotion,  and  other  ways  could  be  found  to  reward  out¬ 
standing  performers. 

EXAMPLES  OF  EFFECTIVE  OJT  PROGRAMS 

The  approach  described  above  has  been  applied  in  the 
field  and  proven  to  be  effective.  I  have  already  mentioned 
the  FRAMP.  which  appear  to  be  highly  successful  for  the 
Navy.  I  am,  however,  most  familiar  with  the  Task  Oriented 
Training  (TOT)  program  instituted  by  TAC  during  1975- 
1976,  whose  objective  was  to  provide  more  effective  prac¬ 
tical  training  to  TAC  maintenance  personnel. 

Task  oriented  training  will  teach  a  man  the  knowl¬ 
edge  and  skills  necessary  to  perform  specific  tasks 
that  are  required  in  his  current  job  assignment.  This 
program  will  produce  more  capable  graduates  in  a 
shorter  amount  of  time  who  are  able  to  perform  the 
duties  required  by  their  supervisors.  This  will  reduce 
the  training  burden  on  supervisors  and  complement 
the  qualification  requirements  of  the  OJT  practical 
channel.  (Headquarters  TAC,  March  1975,  p.  11- 

Maintenance  Training  Management  (MTM)  was  re¬ 
sponsible  for  managing  the  TOT  program,  which  required 
close  interaction  between  wing  personnel  and  the  local 
FTD.  For  example,  a  Plan  of  Instruction  was  written  joint¬ 
ly  by  MTM  and  FTD  personnel.  FTD  personnel  conducted 


all  academic  training  and  some  practical  training,  with 
assistance  by  a  TAC  Instructor  Augmentee,  a  job  qualified 
person  assigned  to  the  TOT  course.  The  Augmentee  cori 
ducted  whatever  practical  training  the  FTD  could  not  con 
duct  and  signed  off  maintenance  actions  taken  on  opera 
tional  equipment,  if  sign-off  was  required  and  the  FTD  in¬ 
structor  was  not  qualified  to  do  so.  Final  certification  of 
the  trainee's  job  proficiency  remained  the  responsibility  of 
shop  management  personnel. 

The  most  significant  feature  of  the  TOT  program  was 
that  TAC  committed  its  own  aircraft,  equipment,  and  per 
sonnel  to  be  used  for  hands-on  training  and  that  these 
commitments  were  included  in  formal  course  documenta¬ 
tion.  This  commitment  required  TAC  to: 

devise  scheduling  procedures  to  incorporate  training 
course,  aircraft,  equipment  and  personnel  require¬ 
ments  into  monthly  and  weekly  published  utilization 
schedules.  (Headquarters  TAC,  February  1975,  p.  4). 

Late  in  1974,  a  number  of  TOT  courses  were  evalu¬ 
ated  in  various  ways.  One,  conducted  by  quality  control 
personnel,  was  of  the  ability  of  TOT  graduates  to  perform 
specific  tasks.  No  discrepancies  in  task  performance  were 
noted  for  35  3-level  graduates  at  Seymour  Johnson  Air 
Force  Base. 

It  is  significant  to  note  that  graduates  of  former  FTD 
courses,  which  were  not  "task  oriented,"  were  not 
capable  of  being  immediately  administered  MSEP 
(Maintenance  Standardization  and  Evaluation  Pro 
gram)  evaluations  due  to  the  fact  that  they  were 
taught  system  orientation  versus  task  orientation. 
(Minutes  of  January  21-23,  1975,  Task  Oriented 
Training  Conference,  p.  1). 

Although  TOT  is  no  longer  a  separate  TAC  program, 
TAC  has  continued  to  press  for  formalized,  practical 
training  in  maintenance  specialties  that  have  suffered 
from  inadequate  OJT  in  the  past,  especially  those  in  which 
people  work  under  production  pressure.  One  significant 
result  has  been  that  many  FTD  courses  are  being  designed 
fully  to  qualify  maintenance  personnel  on  a  specified  set 
of  frequently  performed  tasks.  (Headquarters  TAC,  1978, 
pp.  3-1,  3-2). 

McLarty  describes  a  less  structured  approach  that  has 
been  used  for  orienting  new  turret  mechanics  to  their  jobs. 

Regardless  of  how  serious  your  turret  problems  may 
be,  a  few  weeks  spent  in  unit  orientation  and  closely 
supervised  training  will  pay  dividends  in  the  long  run. 
Some  units,  usually  those  who  indicate  the  most  satis 
faction  with  their  turrent  mechanics,  keep  newly  as¬ 
signed  turret  mechanics  at  battalion  level  for  a  period 
of  2  to  3  weeks  prior  to  assigning  them  to  a  line 
company.  During  this  period  they  conduct  formal  . 
(OJT)  which  acquaints  the  men  with  unit  standard 
operating  procedures  .  .  .,  battalion  supervisory  per¬ 
sonnel,  provides  additional  training  in  those  areas 
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currently  comprising  unit  problem  areas,  reviews 
skills  .earned  as  much  as  2  to  3  montns  earlier,  and 
teaches  those  tasks  not  formally  taught  at  the  Armor 
School.  This  period  of  time  also  provides  an  impor¬ 
tant  transition  period  during  which  the  new  turret 
mechanic  adjusts  to  the  differences  between  school 
and  unit  environment  ....  The  battalion  turret  me¬ 
chanic  supervisor,  Master  Gunner,  or  senior  turret 
mechanic  is  normally  charged  with  supervising  this 
training,  and  all  can  assist.  (McLarty,  p.  10). 

Similar  approaches  were  urged  for  Army  land  vehicle  main¬ 
tenance  MOS  currently  suffering  for  lack  of  skilled  mainte¬ 
nance  personnel. 


McLarty,  Maior  William  T.  "My  Turret  Mechanic  Can't. 
Armor.  Fort  Knox,  KY  40121:  U.  S.  Army  Armor 
Center,  July-August  1978. 

Minutes  of  January  21-23,  1975,  Task  Oriented  Training 
Conference.  Langley  AFB,  VA:  Headquarters  t AC, 
January  1975. 

Pieper,  William  J.,  Robert  W.  Swezey,  and  Horace  H. 
Valverde.  Learner-Centered  Instruction  (LCD:  Vqi 
ume^VjJ.  Evaluation  of  tjte  LCI  Approach.  Wright- 
Patterson  AFB,  Ohio:  Training  Research  Division. 
Air  Force  Human  Resources  Laboratory,  Air  Force 
Systems  Command,  February  1970. 


CONCLUSIONS 

In  this  paper  I  have  sketched  an  approach  to  mainte¬ 
nance  OJT  that  will,  I  believe,  relieve  the  deficiencies  ex¬ 
hibited  by  many  current  programs,  particularly  those  that 
are  the  responsibility  of  maintenance  personnel  working  in 
a  production  environment.  The  approach  I  have  described 
has  been  distilled  not  only  from  accepted  principles  of 
training  but  from  the  example  of  successful  OJT  programs 
in  the  field. 


REFERENCES 

An  Optimum  Training  System  in  Apprenticable  Qccupa 
tions.  Volume  1.  Washington,  D.  C.  20402:  U.  S. 
Department  of  Labor,  Manpower  Administration, 
1970. 

ATC/TAC  Task  Oriented  Training  Report.  Langley  AFB, 
VA:  Headquarters  TAC,  February  1975. 

Carpenter-Huffman,  Polly  and  Bernard  D.  Rostker.  The 
Relevance  of  Training  for  the  Maintenance  of  Ad¬ 
vanced  Avionics.  Santa  Monica,  CA  90406:  The 
Rand  Corporation,  December  1976. 

DOD  and  USAF  Communications-Electronics  Training  Ser 
vice  Test  Program,  Synoptic  Report  for  Volumes  2 
through  1_  Randolph  AFB,  TX:  Air  Training  Com¬ 
mand,  May  27,  1968. 

POO  and  USAF  Communications-Electronics  T raining  Ser¬ 
vice  Test  Program,  Synoptic  Report.  Randolph  AFB, 
TX:  Air  Training  Command,  May  28,  1970. 

Duren,  Richard  E.  A  Proposed  Course  for  Avionics  Tech- 
nicians.  Santa  Monica.  CA  90406:  The  Rand  Corpo¬ 
ration,  December  1976. 

Harz,  Chris.  Results  of  a  Survey  of  Army  Land  Vehicle 
Maintenance  Personnel.  Santa  Monica,  CA  90406: 
The  Rand  Corporation,  1978  (in  press). 

Implementation  Plan,  Task  Oriented  Training  Program; 
TAC-Wide.  Langley  AFB,  VA:  Headquarters  TAC, 
March  1975. 


SQT--A  Guide  for  Leaders.  Fort  Eustis,  VA  23604:  Indi 
vidual  Training  Evaluation  Directorate,  1  April  1977. 

Taylor,  John  E„  Eugene  R.  Michaels  and  Mark  F.  Brennan. 
The  Concepts  of  Performance-Oriented  Instruction 
Used  in  Developing  the  Experimental  Volunteer 
Army  Program.  Persidio  of  Monterey,  CA:  Human 
Resources  Research  Organization,  Division  No.  3, 
March  1972. 

Wemgarten,  Jacklyn,  E.  Hungerland,  and  Mark  F.  Brennan 
Development  and  Implementation  of  a  Quality-As 
sured  Peer-Instructional  Model:  Final  Report  on 
Work  Unit  APSTRAT.  Presidio  of  Monterey,  CA: 
Human  Resources  Research  Organization,  Division 
No.  3,  April  1972. 

BIOGRAPHICAL  SKETCH 

Margaret  Carpenter-Huffman,  Senior  Research  Staff, 
Rand  Corporation,  is  director  of  several  studies  in  the  areas 
of  personnel  and  training.  She  received  her  Bachelor's  in 
education  (cum  laude)  and  her  Master's  in  mathematics 
from  Ohio  State.  She  has  conducted  research  in  a  variety 
of  fields  including  command  and  control,  education  tech 
nology,  and  education  management. 


k 


23/24 


.2 


1 


NAVTRAKCtUIPCEM 


DO  AUTOMATED  MAINTENANCE  DEPENDENCE  CHARTS 
MAKE  PAPER-COVERED  JFAs  OBSOLETE? 

Dr.  Ralph  A.  DePauI ,  Jr. 
President,  DETER  Systems,  Inc. 

Villa  Park,  California 


ABSTRACT 

Job  Performance  Aids  muse  provide  exhaustive  troubleshooting;  solve  all 
problems;  be  easy  to  use  and  to  update;  motivate  the  technician;  help  de¬ 
sign;  assist  other  aspects  of  Integrated  Logistics;  lightweight;  and  reduce 
human  error  in  preparation. 

It  is  impractical,  from  a  volume  standpoint  alone,  to  implement  the 
quancum  of  required  information.  At  least  one  proven  non-paper  technique 
which  is  not  ATE  and  not  committed  to  one  equipment  has  been  validated  by 
the  Armed  Services.  "Only  those  bold  enough  to  take  up  the  challenge  will 
benefit  from  the  nutrition  and  vitality  that  ensues  from  this  new  form  of 
non-paper,  but  simple,  Job  Performance  Aid”. 


The  foliage  was  a  deep  green,  and  the 
scree cning  of  a  blrdllke  creature  awakened 
everything  in  its  flight  path.  A  ground- 
borne  silhouette  resembling  a  man,  for  lack 
of  another  name,  appeared  from  within  a  pro¬ 
tective  cave.  The  man,  standing  on  two 
limbs,  yawned,  looked  up  at  the  sky,  disap¬ 
peared  back  in co  che  cave,  and  returned  with 
some  sort  of  a  pointed  stake  in  one  hand  and 
was  followed  by  a  smaller  replica  of  him¬ 
self,  apparently  an  offspring.  The  two 
creatures  awkwe-dly  found  their  way  to  what 
appeared  to  be  a  swampy  patch  of  ground, 
then  on  further  tc  a  clear  body  of  water, 
from  afar  the  larger  man  could  oe  heard  mak¬ 
ing  sounds  co  which  the  smaller  creature 
seemed  to  respond.  The  large  man  drove  the 
pointed  stake  into  the  dear  water  in  which 
he  was  standing,  raised  it  from  the  water, 
and  retrieved  a  sizeable  flah.  Then,  the 
man  gave  the  stake  to  his  offspring  to  per¬ 
form  the  same  cask  while  che  larger  man  con¬ 
tinuously  uttered  intonations.  The  youth 
responded  by  driving  the  stake  into  the 
water  several  times  until  he  also  served  up 
a  dangling  fish.  And  so,  this  produced  the 
first  method  of  one  creature  instructing 
another  how  to  obtain  what  would  become  its 
nourishment  for  survival.  The  instruction, 
as  crude  as  it  might  have  been,  today  would 
have  been  called  a  Job  Performance  Aid. 


Our  prehistoric  ancestors  used  imple¬ 
ments  and  instructions  to  help  them  perform 
tasks  whether  they  be  for  pleasure  or  exis¬ 
tence.  This  lasted  for  a  few  thousand  years 
until  man  found  methods  of  recording  what  he 
did  so  others  could  learn  from  the  record¬ 
ings.  Thus,  the  preamble  to  man's  quantum 
Jump  into  "modern  time"  recordings.  We  dov 
find  ourselves  in  situations  where  acre  re¬ 
cordings  are  not  enough.  Today,  we  have  de¬ 
rived  a  SOURCE  document  of  what  has  become 
an  impediment  rather  than  an  aid  in  showing 
each  other  how  to  accomplish  a  new  task. 
Remember,  this  SOURCE  is  not  the  teacher  but 
is  to  be  uBed  to  provide  paper  instructions 
detailing  how  a  job  is  to  be  performed.  For 
a  while,  most  of  us  were  overwhelmed  and 
timid  about  using  the  SOURCE  to  provide  in¬ 
structions,  and  the  silent  but  explicit  out¬ 
cry  was  "Let  Harry  do  it!”  Why?  Because 

Harry  was  the  handy  person  who  always  seemed 
co  have  that  lnate  technical  sense  to  solve 
technical  problems  without  using  the  SOURCE 
and  was  able  and  willing  to  do  our  Job  for 

us.  Do  you  remember  what  happened  after 

World  Wars  1  and  II?  Back  we  went  to  the 

necessities  of  doing  jobs  for  ourselves,  and 
with  it  came  our  ever  present  SOURCE  to  pro¬ 
vide  "Job  Performance  Aids".  Into  the  Elec¬ 
tronic  Age  of  the  1950s  and  1960s  it  became 
ever  more  of  a  necessity  to  perform  Jobs 
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with  some  sort  of  assistance-  Electronic 
expertise  was  not  so  plentiful  that  a  one- 
for-ont  training  situation  could  occur,  es¬ 
pecially  In  the  Military  where  most  of  the 
inroaas  in  electronics  were  being  made  under 
itir  sponsorship  of  the  U.S.  Government. 
Yes,  1  suppose  someone  will  relate  the  de- 
Jr.opment  of  tne  transistor  by  Mr.  Shockley, 
Put  rememoer,  the  Company  from  whom 
y-  Stock. e\  received  his  renuoeratlon  was 
ve  ,■  ■■  heavily  supporteo  by  the  U.S.  Govern¬ 
or.,!  .  The  ever  watchful  Federal  Government 

ruv.ico  lands  to  design  and  develop  all 
..net  or  e.ectronic  equipment.  Today,  we 
wou.c  r,uma..y  pay  for  work  by  Mr.  Shockley 
ar.  account  which  our  financial  personnel 
•crz.  Independent  Research  and  Development" 
;  .J  .s  paid  for  to  a  large  extent  by 
..jvernment  Contracts). 

S>  the  -ate  :950s,  our  Armed  Forces  be- 

to  Pe  come  more  dependent  upon  the  elec- 
run;  c  wizardry  of  industry.  Enter,  Job 
rerrormance  Aids  again!  Training  and  Main¬ 
tenance  had  to  be  handled  to  a  large  extent 
r  v  tne  Electronic  Systems  Contractors.  In 
tne  middle  to  lace  1950a,  while  working  for 
one  of  these  Government  Contractors,  1  per¬ 
sonally  supervised  about  160  degreed  engi¬ 
neers  who  accomplished  only  one  facet  of  a 
technical  manual  of  maintenance  instruc¬ 
tion.  That  was  the  engineering  writing. 
Illustrated  Parts  Breakdown  Manuals,  as  well 
as  multitudes  of  other  manuals,  were  accom¬ 
plished  by  another  set  of  people  all  using 
different  SOURCES.  To  continue  the  compli¬ 
cation,  illustrating,  production  and  quality 
control  were  handled  by  even  different 
groups.  The  total  number  of  personnel  in¬ 
volved  in  providing  these  "maintenance  aids" 
was  over  250.  The  annual  dollar  volume  con¬ 
sumed  each  year  amounted  to  approximately 
$6  ,000,000.  Perhaps  this  does  not  seem  to 
be  a  large  number  of  personnel  providing  Job 
Performance  Alda  or  even  a  large  annual  ex¬ 
penditure  by  today's  standards.  Today's 
larger  companies  are  likely  to  employ  300  or 
more  personnel  producing  Job  Performance 
Aids  with  annual  costs  reaching  the 

tl5,000,000  mark.  Is  it  any  wonder  that  the 
volumes  of  technical  manuals  produced  each 
year  for  our  Armed  Forces  runs  into  the  100s 
of  millions  of  dollars  each  year?  Picture 
the  year  1958  when  an  airborne  radar  set 
basically  consisted  of  the  antenna,  power 
supply,  transmitter,  receiver,  and  synchron¬ 
izer  (rather  than  a  computer)  using  tubes. 


as  well  as  transistors,  as  the  active  ele¬ 
ments  having  a  total  weight  of  about  80 
pounds.  This  was  my  introduction  into  JOB 
PERFORMANCE  AIDS  printed  on  paper. 

All  publications  were  heavy  on  the 
theory  and  illustrations  because,  remember, 
the  military  technician  ha6  not  seen  this 
new  breed  of  electronics.  Troubleshooting 
malfunctions  was  only  described  on  paper  by 
the  brave  at  heart  who  made  assumptions  of 
what  might  go  wrong  in  the  field  for  inser¬ 
tion  into  the  paper  manuals.  Indeed,  this 
reaction  still  exists  today.  When  these 
paper  Job  Performance  Aids  failed  to  make 
the  military  technician  as  competent  as  the 
Contractor's  Field  Engineer,  we  changed  the 
format  of  the  Job  Performance  Aid,  and 
changed  it  and  changed  it.  Dr.  John  F. 
Foley,  Jr.  of  the  Air  Force  Human  Resources 
Laboratory,  Brooks  AFB,  Texas,  gives  a  re¬ 
cent  and  couprehensive  picture  of  how  Job 
Performance  Aids  have  changed  in  his  report 
entitled  Executive  Summary  Concerning  the 
Impact  of  Advanced  Maintenance  Data  and  Task 
Oriented  Training  Technologies  on  Mainte¬ 
nance,  Personnel,  and  Training  Systems^. 
Of  course,  neither  Dr.  Foley,  nor  Dr.  King 
in  his  article  entitled  New  Concepts  in 
Maintenance  Training2  has  been  able  to 
cover  the  complete  spectrum  of  the  types  of 
publications  devoted  to  Job  Performance 
Aids.  What  Dr.  King  does  do,  however,  is  to 
point  out  the  distinction  between  publica¬ 
tions  serving  as  "book”  knowledge  and  other 
forms  of  Job  Training  Aids  which  give  "head” 
knowledge.  Until  very  recently  (circa 
1974),  the  military  and  industry  consumed 
much  of  its  resources  in  "improving"  Main¬ 
tenance  Job  Performance  Aids  in  the  form  of 
paper  or  plastic  materials.  In  a  few  in¬ 
stances  display  boards  were  constructed 
which,  figuratively,  lit-up  and  depicted  a 
block  diagram  of  how  an  equipment  func¬ 
tioned.  Electrical  switches  were  placed  in 
convenient  places  to  deenergize  certain  por¬ 
tions  of  the  block  diagram,  and  we  then  had 
a  crude  hardware  maintenance  Job  Performance 
Aid. 

Before  we  go  too  far,  let's  examine  some 
of  the  attributes  of  a  good  Job  Performance 
Aid  and  try  to  analyze  the  best  way  to  ac¬ 
complish  such  a  maintenance  or  maintenance 
training  aid  for  the  Military  Technician 
today. 


Report  Number  VASHRL-TR-24  by  Dr.  Foley,  March,  1978. 
Aviation  -  Engineering  and  Maintenance,  Nov/Dec  1978. 
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l)  The  Aid  should  cover  an  almost  ex¬ 

haustive  jmounc  ot  troubleshooting 
Information,  especially  causes  and 
et'ieets  which  may  not  be  apparent 
on  a  daily  basis. 

1)  The  Aid  should  be  capable  of  help¬ 

ing  to  solve  multiple  malfunction* 
which  exist  separately  or  simultan¬ 
eously  . 

3)  The  Aid  should  be  rapid  and  allow 

easy  access  to  malfunctions-  It 
must  also  allow  diagnostic  trouble¬ 
shooting  to  begin  with  ANY  known 
sensory  event  not  occurring  proper¬ 
ly. 

4)  The  Aid  should  be  capable  of  having 
its  information  revised  or  updated 
quickly  and  inexpensively  without 
restriction  as  to  whom  is  accom¬ 
plishing  the  revislon(s). 

3)  The  Aid  should  help  motivate  the 

technician.  That  is,  he  must 
achieve  success  in  accomplishing 
his  maintenance  or  learning  task. 

6)  The  same  Aid  should  be  capable  of 
being  utilized  with  numerous  equip¬ 
ments  or  models  of  equipments. 

7)  The  Aid  should  also  be  an  asset  in 
helping  to  disclose  weaknesses  of 
Reliability  or  Maintainability  in 
equipment  design. 

8)  The  Aid  should  be  capable  of  being 
utilized  in  actual  maintenance 
situations  as  well  as  "on  the  Job" 
training  situations.  There  should 
not  be  the  need  for  complete  dupli¬ 
cation  of  maintenance  material  to 
achieve  training  material. 

9)  The  Aid  should  have  some  method  of 
being  validated  and  verified  prior 
to  delivery  to  the  customer.  By 
this,  we  mean  that  the  actual  pro¬ 
cedural  information  oust  be  proven, 
not  only  the  result  of  some  test 
(i.e.,  Is  the  sequence  correct?). 

10)  The  Aid  should  facilitate  under¬ 
standable  communication  from  the 
operator,  to  unit  maintenance,  to 


shop  or  intermediate  maintenance, 
and  to  depot  or  factory  mainte¬ 
nance. 

11)  The  Ala  should  be  capable  of  back- 
lng-up  BIT  at  any  level  of  mainte¬ 
nance. 

12)  The  Aid  should  be  useable  by  exper¬ 
ienced  maintenance  personnel  and 
those  who  have  not  previously  main¬ 
tained  a  particular  system.  An  im¬ 
portant  aspect  would  be  to  provide 
for  those  who  have  Just  matricu¬ 
lated  from  a  basic  course  in  elec¬ 
tronics,  mechanics,  optics,  or 
hydraulics. 

13)  The  Aid  should  be  capable  of  as¬ 
sisting  Contractors  and  Customers 
to  determine  what  should  be  a  spare 
/repair  part  and  what  quantities 
are  required  for  different  scenar¬ 
ios  or  missions  as  well  as  Life 
Cycles. 

14)  The  Aid  should  be  one-man  portable 
and  easily  stored.  It  should  not 
require  expensive  and  unusual  stor¬ 
age  facilities. 

15)  The  Aid  should  be  capable  of  pro¬ 
ducing  a  hard  copy  of  the  actual 
maintenance  action  performed  by  the 
technicians.  This  copy  could  then 
be  used  by  supervisors  to  validate 
work  accomplishment  and  to  give 
further  assistance  to  technicians. 

16)  Preparation  of  the  Aid  should  allow 
the  least  possible  human  error. 

Most  naturally  we  have  all  answered 
these  questions  with  either  a  retort  of 
"this  is  impossible"  or  "1  am  doing  this 
today”.  If  your  answer  is  "this  is  impossi¬ 
ble",  you  must  do  some  soul  searching  as 
well  as  -  getting  out  into  the  world.  If 
you  have  answered  "I  am  doing  this  today”, 
then  for  everyone's  sake  share  what  you  have 
with  the  rest  of  the  same  community.  What 
or  who  is  your  SOURCE?  How  can  we  implement 
it?  What  can  we  do  to  help? 

The  real  message  to  this  paper  is  to 
share  what  I  and  those  dedicated  people  in 
our  Company  have  been  doing  to  provide  a  Job 
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Pertormance  Aid  which  has  most  of  the  quali¬ 
ties  just  enumerated.  Our  SOURCE  has  not 
been  one  Military  Specification  but  the  com¬ 
bined  intents  of  several,  with  a  dash  of 
Common  Sense.  We  could  not  use  the  "paper" 
Job  Performance  Aid  method  because  it  would 
have  become  too  bulky  for  any  given  system 
"larger  than  a  breadbox".  It  needed  today’s 
"State  of  the  Art"  in  electronics,  and  it 
needed  definition  and  simplification  of  a 
concept  1  began  over  twenty  years  ago.  The 
LOGMOD  Methodology  and  Diagnostic  Test  Set 
are  the  result.  Using  the  simple  Logic 
Model  Algorithm  (probably  known  as  a  Mainte¬ 
nance  Dependency  Chart  to  most  people)  we 
recorded  schematic  Information  on  a  magnetic 
disc.  With  the  aid  of  a  processor,  memory 
and  readout  device  we  have  proven  that  most 
of  the  Aid  Requirements  could  be  met.  The 
device  is  passive  (not  connected  directly  to 
an  equipment  being  diagnosed)  and  can  be 
hand  transported  by  one  individual  with  the 
same  ease  as  carrying  a  IS"  portable  color 
T.V.  set.  Although  we  do  not  consider  the 
present  medium  (LOGMOD  Diagnostic  Test  Set) 
the  ultimate  in  design  for  world-wide  use, 
it  is  capable  of  providing  most  of  the  an¬ 
swers  to  our  Job  Performance  Aid  questions. 
Also,  it  is  very  difficult  sometimes  when 
showing  or  discussing  the  LOGMOD  Job  Perfor¬ 
mance  Aid  medium  to  really  show  the  attri¬ 
butes  of  the  entire  "system".  The  system  is 
not  only  the  medium,  but  it  is  the  use  of  a 
Logic  Model  Algorithm  in  schematic  analysis, 
test  messages,  fault  messages,  and  a  "type 
of  index".  Presently,  illustrations  are 
still  provided  and  keyed  to  paper  or  plastic 
reproductions.  The  Logic  Model  Algorithm 
plays  the  key  role  in  affording  a  multi-use¬ 
able  Design,  Reliability,  Maintainability, 
Maintenance  Analysis,  Repair  Parts  Cost, 
Test  Sequences  Organizer,  and  Validator/Ver- 
ifier.  In  the  future,  it  will  also  add 
maintenance  training  to  its  repertoire.  The 
Algorithm  has  been  committed  to  a  sizeable 
computer  (apart  from  the  LOGMOD  Diagnostic 
Test  Set)  which  has  not  changed  in  the  last 
five  years,  yet  has  produced  LOGMOD  discs 
for  mechanical,  electro-mechanical,  hydrau¬ 
lic,  and  purely  electronic  systema  for  the 
Army,  Navy,  and  Air  Force.  In  fact,  each 
Service  has  procured  at  least  one  of  the 
LOGMOD  Diagnostic  Test  Sets.  The  U.S.  Air 
Force,  In  an  October  1978  report  written  by 
Major  Billy  F.  Lacy  and  Captain  John  B. 
Berry-*,  after  three  months  of  extensive 
testing  using  the  LOGMOD  concept  and  mechan¬ 


ism  has  concluded  the  following: 

1)  LOGMOD  is  a  workable  concept  and 
could  serve  as  an  efficient  and 
effective  troubleshooting  aid- 

2)  Subjects  preferred  LOGMOD  over 
other  troubleshooting  aids  (meaning 
T.O.s  and  FPJTAs)  at  the  intermedi¬ 
ate  level  of  maintenance.  Conse¬ 
quently  there  is  a  high  probability 
of  user  acceptability  if  the  LOGMOD 
concept  is  applied  to  other  Air 
Force  systems  at  this  level  of 
maintenance. 

The  Air  Force  report  also  states  that 
the  "LOGMOD  potential  has  been  validated”. 
Mr.  W.  L.  Andre  of  the  U.S.  Army  Aviation 
Command's  Research  Technology  Laboratory  has 
made  similar  comments  in  the  Army's  public 
release  to  VERTIFLITE  MAGAZINE  (Sept/Oct 
1978)3 4  and  the  ARMY  RESEARCH  AND  DEVELOP¬ 
MENT  MAGAZINE  (Sept/Oct  1978)5.  Mr.  Andre 
has  pointed  out  the  uses  of  LOGMOD  in  design 
as  well  as  in  maintenance. 

The  question  of  whether  the  Government/ 
Industry  attacks  at  Job  Performance  Aids  re¬ 
maining  in  the  paper  form  seems  to  have  been 
answered.  The  mechanization  of  LOGMOD, 
claimed  to  have  been  highly  Improbable  four 
years  ago  at  the  first  of  these  Biennial 
Conferences  conducted  by  the  Naval  Equipment 
Training  Center,  has  now  been  accomplished. 
The  conventional  paper  documentation,  above 
which  it  replaces,  equates  to  about  one  5 
1/2"  (diameter)  floppy  disc  to  500  pages  of 
written  material.  There  are  no  estimates  of 
how  much  paper  documentation  the  LOGMOD  con¬ 
cept  replaces  when  considering  design  in¬ 
fluences,  multiple  malfunction  strategies, 
and  exhaustive  malfunction  diagnostics,  be¬ 
cause  there  exists  no  paper  equivalent  to¬ 
day.  The  stake  has  been  cast  and  the  fish 
dangling.  Only  those  bold  enough  to  take  up 
the  challenge  will  benefit  from  the  nutri¬ 
tion  and  vitality  that  ensues  from  thi6  new 
form  of  nonpaper,  but  simple,  Job  Perfor¬ 
mance  Aid. 

To  those  of  you  who  take  up  the  chal¬ 
lenge,  just  a  few  words  of  advice  overheard 
from  several  government  personnel:  make  it 
so  simple  that  children  in  grade  school  can 
use  it;  make  it  as  light  as  a  feather;  give 
it  the  knowledge  and  memory  of  all  equipment 
designers;  and  make  it  free  of  charge. 


3L0GM0D  DIAGNOSTICS  Project  Number  760701,  Air  Force  Logistics  Management  Center, 

15  October  1978. 

4Vertiflite,  LOGMOD-the  Fault-Isolator,  by  William  L.  Andre,  Sept/Oct  1978. 

5Army  Research  and  Development,  Helicopter  Fault  Isolation  Equipment  Evaluated  by  Armed 
Services ,  by  William  L.  Andre,  Sept/Oct  1978. 
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1 . 0  LOCMOD 

Tnt  Logic  Model  Analysis  Technique 
(LOGMOD)  is  a  computerized  maintenance  and 
fault  isolation  concept  Chat  is  considered 
proprietary  to  DETEX  Systems,  Inc., 
Cal  If ornia. 


basically,  the  technique  involves  the 
appl.cation  of  the  LOCMOD  computer  program 
and  the  associated  LOGMOD  Diagnostic  Strate¬ 
gy.  The  LOGMOD  computer  program,  developed 
by  DETEX  Systems,  Inc.,  accepts  inputs  in 
the  term  of  dependency  chains  that  show  the 
interrelationships  of  each  functional  ele¬ 
ment  (or  group  of  components)  of  a  design 
anc  generates  a  logic  model  for  the  design. 
The  logic  model  is  usually  displayed  as  a 
c.art  with  all  the  dependency  chains  organ- 
iced  in  such  a  fashion  that  systematic  fault 
isolation  procedures  can  be  observed  through 
the  application  of  che  LOGMOD  Diagnostic 
Strategy . 

1.1  CKAPtilC  DISPLAY  OF  BASIC  LOGMOD  CONCEPT 


The  basic  form  of  a  logic  model  is  con¬ 
structed  by  firsc  listing  all  the  functional 
elements  (or  groups  of  components)  and  their 
associated  inputs  and  outputs.  Next,  proce¬ 
dure.  information  i6  applied  to  establish 
the  dependency  of  the  output  events  on  pre¬ 
vious  events  and  functional  elements  in  the 
form  of  dependency  chains.  Events  are 
things  that  are  observable  whether  they  can 
be  seen,  heard  or  measured  using  external 
test  equipment .  A  dependency  chain  is 
graphically  represented  by  a  logic  mechanism 
of  three  basic  symbols:  a  pound  sign  (#),  a 
character  0  and  a  character  U.  Below  is  an 
example  of  a  simple  logic  model  display  con¬ 
structed  from  the  given  functional  block 
diagram. 


Functional  Block  Diagram  Logic  Model 

The  t  sign  denotes  the  event  (or 
state).  The  character  0  denotes  the  func¬ 
tional  element  (or  a  group  of  components). 
The  character  U  denotes  the  previous  event 
which  the  event  t  is  depending  on.  The 


example  shows  the  dependency  of  the  output 
event  "Z"  on  the  functional  element  ”Y"  in 
the  presence  of  the  input  event  "X”.  Using 
this  scheme,  dependency  chains  of  complex 
electrical,  mechanical  or  electronic  systems 
can  be  constructed.  Each  dependency  chain 
forms  a  horizontal  line  on  the  logic  model 
display.  Hence,  the  logic  model  is  a  sym¬ 
bolic  representation  of  the  functional  oper¬ 
ations  of  the  system.  For  complex  systems, 
the  manual  construction  of  logic  model  dis¬ 
plays  can  be  very  tedious  and  time  consum¬ 
ing.  Through  the  use  of  the  LOGMOD  computer 
program,  complex  systems  are  modeled  logi¬ 
cally,  very  efficiently  and  easily  dis¬ 
played.  In  addition,  changes  can  be  made 
painlessly. 

1.2  FUNCTIONAL  LOGIC  MODELS 

The  Functional  Logic  Model  Display  (as 
shown  in  Figure  1.1)  shows  each  functional 
element  and  its  interrelationships  with 
other  elements.  In  general,  the  relative 
position  or  order  of  the  functional  element 
(or  part)  in  the  columns  from  left  to  right 
is  indicative  of  the  degree  of  dependency  of 
the  functional  part.  The  operational  status 
associated  with  each  functional  element  may 
be  monitored  at  a  pre— determined  test  point, 
and  the  measured  result  can  be  compared  with 
the  specification  for  that  test  point.  The 
body  of  the  logic  model  display  portrays  the 
dependency  chain  structure  as  the  inputs  are 
processed  through  the  functional  elements  to 
produce  the  desired  outputs.  The  complex 
relationships  are  clearly  and  precisely  de¬ 
fined.  In  addition,  logic  models  generated 
by  the  LOGMOD  computer  program  are  the  ones 
with  their  dependency  chains  organized  in  a 
hierarchy  of  least  dependent  to  most  depen¬ 
dent.  With  this  logical  representation  of  a 
design,  it  is  possible  to  structure  a  sys¬ 
tematic  approach  to  diagnostic  testing  and 
to  the  design  for  reliability  and  maintain¬ 
ability  . 

1.3  LOGMOD  DIAGNOSTIC  STRATEGY 

The  L0Q10D  Diagnostic  Strategy  is  a 
fault  isolation  methodology  applicable  to 
logic  models  developed  through  the  use  of 
LOCMOD  computer  program.  The  LOCMOD  Diag¬ 
nostic  Strategy  can  be  described  as  fol¬ 
lows: 

The  logic  model  is  entered  at  a  BAD  (out 
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TP1  TP-5 


Figure  1.1  Functional  Logic  Model 


o:  specification)  terminal  event  either  by 
observation  of  some  Indicator  or  through  in¬ 
dication  of  a  previous  higher  level  test 
which  narrowed  the  problem  to  this  level.  A 
terminal  event  is  an  event  which  no  other 
event  will  depend  on.  The  method  of  fault 
isolation  used  can  be  thought  of  as  "the 
half-spilt  method  of  good  events”.  The 
first  check  is  made  at  the  related  event 
nearest  the  input  events  (most  upper  left  of 
the  logic  model  display)  in  the  dependency 
chain  of  the  BAD  termloal  event.  If  this 
first  test  is  GOOD  (that  is,  within  specifi¬ 
cation),  then  a  second  check  is  made  at  the 
half-way  point  between  the  GOOD  event  and 
the  BAD  terminal  event.  The  half-way  point 
is  where  the  related  events  between  the  GOOD 
event  and  the  BAD  event  are  halved.  If  the 
second  test  la  also  GOOD,  then  the  procedure 
mentioned  above  will  be  repeated.  However, 
If  the  event  test  is  BAD,  that  event's 
furthest  lefc  dependency  (on  the  display) 
will  be  tested.  Eventually,  a  line  (that 
Is,  s  dependency  chain)  Is  entered  that  has 
all  of  Its  input  events  test  GOOD  thereby. 
Isolating  the  failure  to  the  functional 
entity  on  that  line. 

2.0  LOGMOD  PREPARATION 

1)  LOGMOD  Algorithms  already  exist; 
therefore,  no  programming  time  is 
required  to  use  them  immediately. 

2)  LOGMOD  Algorithms  merely  required 


knowledge  inputs*  These  inputs 
must  be  made  by  either  technical  or 
managerial  personnel  with  an  under¬ 
standing  of  some  segment  of  a  com¬ 
plete  system. 

3)  Random  inputs  to  the  LOGMOD  Algori¬ 
thm  will  automatically  be  organized 
into  one  complete  data  base  showing 
all  Interdependence  of  actions  or 
components  analyzed  by  all  indivi¬ 
duals. 

4)  LOGMOD  Inputs  can  be  generated  com¬ 
pletely  by  company  personnel.  A 
relatively  small  capital  expendi¬ 
ture  for  the  use  of  the  LOGMOD 
Algorithm  would  make  the  company 
self-sustaining . 

5)  Almost  immediate  productivity  can 
be  made  of  present  company  person¬ 
nel  (after  a  five-day  training 
period  by  DETEX  Systems,  Inc.). 

6)  Its  flexibility  in  use  allows  the 
analyst  to  provide  a  checkout 
sequence  suitable  to  the  equipment 
while  never  changing  the  exhaus¬ 
tiveness  of  testing. 

3.0  LOGMOD  APPLICATIONS 

3.1  DESIGN 
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1)  Disclosure  of  design  information  - 

This  means  the  designer's  notebook 

and  thoughts  that  went  into  the  de¬ 
sign  of  a  particular  equipment  are 
completely  preserved  from  program 

to  program  and  forever. 

1)  There  is  more  use  of  equipment 

designer's  time  since  he  does  not 
have  to  recall  past  designs  to 
answer  questions  pertaining  to  that 
past  design. 


port  expenditure  for  any  given  j 

life  period.  < 

6)  Allows  determination  of  correct  and 

optimal  Built-In  Tests  (BIT)  for  j 

Aircraft,  Marine,  and  Land  Opera-  i 

tlonal  Systems. 

i 

7)  Common  Data  Base  for  design  and 

support  decisions.  j 

3.2  MAINTENANCE 


3)  Equipment  designers  will  always 
know  the  impact  of  their  design  on 
support  activities  before  the  hard¬ 
ware  is  committed  to  a  final  con¬ 
figuration. 

4)  It  can  be  used  to: 

a.  Develop  ATE. 

b.  Work  in  conjunction  with  ATE. 

c.  Provide  a  back-up  for  ATE  when 
ATE  is  malfunctioning. 

d.  Provide  complete  diagnostic 

capability  when  no  ATE  is 

available. 

5)  It  can  determine  the  following  ele¬ 
ments  of  support  in  its  Initial 

software  stages: 

a.  Test  point  placement  for  main¬ 
tainability . 

b.  Objective  diagnostic  times  for 

each  replaceable  item  -  im¬ 

pacting  decisions  to  make 
certain  items  more  reliable 
and  others  not  as  reliable. 

The  latter  remark  applies  to 

mechanical  parts  working  to¬ 
gether  where  one  failing  re¬ 

quires  a  complete  set  to  be 
replaced. 

c .  Sequence  of  checking  -  All 

diagnostic  strategies  devel¬ 

oped  automatically  by  LOGMOD. 

d.  Addition  of  item  failure  rates 

provides  calculations  of 

Mean-T ime-t  o-Repa 1 r . 

e.  Validates/verifies  diagnostic 
strategies  before  equipment  is 
fielded. 

f.  Resource  analysis  tradeoffs  - 

design  expenditure  versus  sup- 


1)  Lesser  skilled  maintenance  person¬ 
nel  perform  fault  isolations  with 
the  proficiency  of  higher  skilled 
maintenance  personnel. 

2)  Reduced  maintenance  time  by  using 
optimized  search  on  an  organized 
data  base. 

3)  Does  not  require  the  maintenance 
technician  to  know  design  or  opera¬ 
tional  features  to  perform  mainte¬ 
nance. 

4)  Fault  isolation  is  exhaustive,  that 
is,  faults  can  be  isolated  to  any 
level  desired. 

3)  Provides  diagnostics  equally  as 

well  for  mechanical,  hydraulic, 
electro-mechanical,  electronic, 

optic,  or  any  combination  of  the 
above • 

6)  Works  equally  as  well  with  digital 
and  analog  electronics* 

7)  It  reduces  technical  information 
analomies  among  Management,  Design, 
and  Support  Functions. 

8)  No  computer  programming  knowledge 
required  by  user. 

9)  Packaging  concepts  of  LOGMOD  de¬ 
vices  run  from  large  consoles  to 
small  pocketsized  hand  sets* 

10)  It  can  be  used  in  spacecraft  to 
enable  astronauts  to  make  "on  the 
spot"  diagnoses  of  malfunctions  in 
the  event  they  lose  voice  transmis¬ 
sion  or  reception. 
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11)  Maintenance  technicians  can  Isolate 
malfunctions  in  any  equipment  pro¬ 
viding  they  know  how  to  use  general 
purpose  test  equipment. 

12)  Test  equipment  cribs  could  cali¬ 
brate  and  maintain  all  types  of 
equipment  on  or  off-site  in  shorter 
time,  because  they  do  not  have  to 
refamlllarize  themselves  with  an 
equipment  they  may  see  very  rare¬ 
ly- 

i  3)  Virtually  eliminates  the  need  for 
the  most  Important  parts  of  a  main¬ 
tenance  manual,  i-e.,  troubleshoot¬ 
ing,  schematics,  wiring  or  plumbing 
diagrams,  and  theory  of  operation. 

3.3  TRAINING 

1)  It  can  be  used  as  a  training  device 
with  plctoral  and/or  sound  informa¬ 
tion  available  which  would  be  auto¬ 
matically  cued  by  LOGMOD . 
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AIDING  AND  TRAINING: 

A  PRACTITIONER'S  PERSPECTIVE 

Kay  Inaba,  Ph.D. 

Xyzyx  Information  Corporation 
21116  Vanowsn 
Canoga  Park,  California 


ABSTRACT 

This  paper  presents  a  practitioner's  view  of  aiding  and  training  in  maintenance. 
The  paper  traces  the  development  history  of  aiding,  in  order  to  help  focus  attention 
on  problems  of  application.  General  application  problems  are  discussed,  followed  by 
suggestions  for  resolving  the  problems.  The  paper  contends  that  aiding  and  training  in 
maintenance  represents  an  opportunity  for  the  human  factors  community  to  make  a 
vast  contribution.  However,  the  challenge  requires  resolution  of  application  problems 
by  the  community. 


As  the  title  indicates,  this  presentation  is  from  a  prac¬ 
titioner's  point  of  view.  I  was  a  member  of  what  might  be 
termed  the  "human  factors  research  community"  for  a 
number  of  years  and  enjoyed  it.  However,  for  the  past  ten 
years  or  so  I  have  been  specializing  as  a  practitioner  (sys¬ 
tems  and  human  factors)  and  am  also  enjoying  it. 

Being  a  practitioner,  I  have  taken  certain  liberties  in 
this  presentation  that  may  not  be  permissible  in  a  docu¬ 
ment  by  a  researcher.  For  example,  I  fail  to  cite  references 
when  discussing  work  done  by  others.  Therefore,  you  will 
have  to  take  my  word  for  the  works.  Also,  much  of  my 
evidence  is  the  product  of  repeated  experiences  rather  than 
research  data. 

Despite  the  lack  of  research  orientation,  I  hope  the 
message  has  some  meaning  to  the  audience.  I  sincerely 
pelieve  that  the  human  factors  community  needs  more 
practitioners  who  understand  and  appreciate  the  impor¬ 
tance  of  research  as  well  as  apply  the  results  of  research. 

I  believe  that  both  the  human  factors  researcher  and 
practitioner  have  much  to  contribute.  Unfortunately,  the 
failure  to  distinguish  between  the  two  has  often  led  to 
counterproductive  activities,  which  in  turn  has  caused  lost 
opportunities. 

By  properly  integrating  aiding  and  training,  the  hu¬ 
man  factors  community  can  have  a  significant  impact  on 
improving  the  productivity  of  technicians.  This  potential 
is  especially  large  in  the  field  of  maintenance.  Thus  most 
of  my  comments  in  this  presentation  are  oriented  towards 
maintenance. 


At  first  I  will  try  to  provide  a  historical  perspective  of 
aiding.  Then,  I  will  discuss  some  of  the  more  general  prob¬ 
lems  usually  encountered  when  applying  the  aiding  con¬ 
cept. 

Finally,  I  will  make  some  suggestions  which  I  believe 
would  be  helpful  in  realizing  the  full  potential  of  inte 
grating,  aiding,  and  training  in  maintenance. 

HISTORICAL  PROSPECTIVE  OP  AIDING 
AND  TRAINING  IN  MAINTENANCE 

The  Nineteen  Forties  (1940's) 

Research  in  aiding  appears  to  have  started  in  tne 
1940's  with  some  scattered  research  on  job  guides.  Al¬ 
though  the  research  efforts  were  not  very  extensive,  they 
were  quite  productive.  In  fact,  the  presentation  principles 
which  we  used  to  develop  the  current  format  were  based 
on  research  data  from  the  1940's.  More  of  such  research  is 
needed  to  properly  advance  the  state-of-the-art  in  aiding 
and  training. 

The  Nineteen  Fifties  (1960's) 

Considerably  more  human  factors  attention  was  given 
to  the  aiding  concept  in  the  1950's.  Two  major  contrib 
uting  groups  were  AFPTRC  (Air  Force  Personnel  and 
Training  Research  Center)  and  HUMMRO. 

The  most  notable  work  by  AFPTRC  was  its  concep¬ 
tual  treatment  of  aiding.  Aiding  was  defined  as  one  of  the 
three  means  of  obtaining  the  necessary  personnel  perfor 
mance  capabilities,  i.e.,  selection,  training  and  on-the  job 
aiding.  Although  various  researchers  contributed  to  the 


33 


r  * 


NAVTRAEQUIPCEN  IH-327 


concept,  tne  mosi  prominent  advocate  of  aiding  (or  then 
Known  as  |ob  guides)  was  probab.y  Dr.  J.  Jepson  Wultf.  He 
was  instrumental  in  showing  that  proper  aiding  was  as  im¬ 
portant  as  proper  selection  and  training  of  personnel.  For 
tunateiv,  l  was  one  of  those  so  convinced. 

One  of  the  earliest  attempts  to  apply  the  aiding  con¬ 
cept  in  a  weapons  system  was  made  by  HUMMRO.  Their 
MAlNTRAINi  consisted  of  a  total  set  of  job  guides  for 
supporting  maintenance  on  a  major  weapons  system. 
Or  Ed  Shriver  was  the  guiding  force  behind  MAINTRAIN. 

The  Nineteen  Sixties  (1960's) 

Today's  version  of  aiding  in  maintenance  really 
started  to  take  shape  in  the  1960's.  Three  sets  of  events  in 
the  60  s  were  major  contributors  to  today's  aiding  con¬ 
cept. 

Troubleshooting  procedures:  Considerable  research 
m  procedurahred  troubleshooting  was  conducted  in  the 
1960's  Although  numerous  human  factors  researchers 
were  involved  the  most  prominent  were  probably  Dr. 
John  Foley  (then  at  Wright  Patterson  Air  Force  Base)  and 
Di  Jack  Folley,  the  founder  of  Applied  Science  Associ¬ 
ates  As  is  the  case  with  Ed  Shriver,  both  are  still  active  in 
tne  aiding  field. 

Much  of  the  human  factors  community's  conviction 
of  tne  powe-  of  troubleshooting  procedures  stems  from 
the  ^search  in  the  1960's.  These  studies  gave  quantitative 
evidence  that  nere  are  more  effective  alternatives  to  re¬ 
stricting  troubiesnootmg  to  highly  experienced  technicians 
supported  by  extensive  and  expensive  training. 

BAMAGAT  aka  SIMM  aka  FQMM:  The  BAMAGAT 
concept  was  introduced  by  personnel  then  at  Hughes 
Aircraft  Company.  This  was  a  new  approach  to  aiding 
troubleshooting.  Although  there  are  various  aspects  to  the 
concept.  I  believe  that  the  most  important  was  its  chart 
form  of  ['resenting  component  dependencies.  This  tech¬ 
nique  is  called  the  Maintenance  Dependency  Chart  (MDC). 
Although  BAMAGAT  was  changed  to  SIMM  (Symbolic 
Integrated  Maintenance  Manual),  and  then  to  FOMM 
(Functionally  Oriented  Maintenance  Manual),  it  retained 
the  MDC  as  an  intregal  part  of  the  concept. 

There  are  other  aspects  of  the  SIMM/FOMM  package, 
such  as  schematics  with  functional  boundaries,  etc.  How¬ 
ever,  these  techniques  were  not  necessarily  unique  to 
BAMAGAT.  The  MDC  is  unique  to  SIMM/FOMM  and  I 
believe  the  major  contributor  t  j  the  effectiveness  demon¬ 
strated  in  various  tests.  Unlike  other  aids,  the  SIMM/ 
FOMM  package  is  useful  primarily  to  the  experienced  and 
highly  skilled  technicians,  and  requires  quite  extensive 
training  with  the  aids.  However,  SIMM/FOMM  represents 
a  significant  simplification  of  information  normally  pre¬ 
sented  in  schematics  and  other  complex  diagrams.  In 
contrast,  the  SIMM/FOMM  treatment  of  repair-type  activ¬ 
ities  is  fairly  conventional. 

PIMP  (Presentation  of  Information  for  Maintenance 
and  Operation):  I  have  been  applying  the  aiding  concept 


since  I  first  met  Dr.  Wulff  in  1957.  However,  my  first  for¬ 
mal  study  of  the  concept  did  not  occur  until  the  mid- 
1960s  with  Project  PIMO.  The  project  was  sponsored  by 
the  Ballistics  Systems  Division  (now  SAMSO)  of  AFSC. 
The  project  was  the  brain  child  of  Mr.  Charles  Schaffer 
(then  of  BSD)  and  Dr.  Ed  Triner  (then  of  AFSC  head 
quarters). 

We  tried  to  take  full  advantage  of  the  state-of-the  art 
of  aiding  at  that  time.  Therefore,  we  tried  to  take  full  ad 
vantage  of  the  work  done  by  such  contributors  as  Drs. 
Shriver,  Foley,  Folley,  and  the  developer  of  BAMAGAT 
In  fact,  we  adopted  the  BAMAGAT  approach  to  trouble 
shooting  aids. 

Project  PIMO  made  two  major  contributions  to  the 
aiding  concept  as  is  known  today.  One  is  the  presentation 
format.  This  format  was  based  on  presentation  principles 
developed  from  synthesizing  available  research  data  in  the 
behavioral  sciences.  As  I  mentioned  before,  most  of  the 
relevant  research  were  conducted  in  the  1940's,  or  earlier. 
The  basic  PIMO  format  is  currently  being  used  in  most  Job 
Performance  Aids. 

The  second  major  contribution  of  PIMO  was  relating 
the  effect  of  aiding  to  system  effectiveness.  Since  we  used 
the  systems  approach,  we  expressed  the  improvements  in 
technician  performance  (from  aiding)  in  terms  of  their 
effect  on  such  system  parameters  as  improvement  in  oper 
ational  readiness,  reduction  in  spares  consumption,  reduc¬ 
tion  in  maintenance  manhours,  etc.  Such  expressions 
helped  to  make  the  DOD  decision  makers  aware  of  the 
potential  for  aiding. 

The  Nineteen  Seventies  (1970's) 

The  activities  in  aiding  picked  up  considerably  in  the 
1970's,  primarily  in  support  of  maintenance.  Only  a  smat 
tering  of  research  was  conducted  during  the  1970’s.  Most 
of  the  activities  were  in  demonstrating  the  concept.  Such 
demonstrations  helped  convince  many  that  aiding  must  be 
applied.  However,  the  lack  of  significant  advancements  in 
R  &  D  indicates  an  oversight  which  should  be  resolved  if 
we  expect  to  make  aiding  and  training  an  effective  tool  in 
maintenance. 

Vietnamization:  The  first  major  application  of  the 
aiding  concept  was  in  support  of  the  Vietnamization  pro 
gram.  At  that  time,  the  term  Job  Performance  Aid  (JPA) 
was  officially  adopted  by  the  Air  Force. 

The  basic  objective  for  applying  the  JPAs  was  to  con¬ 
vert  from  (1)  training  in  English  in  the  United  States  to 
(2)  training  in  Vietnamese  in  Vietnam.  This  objective  was 
met  with  the  help  of  aids.  However,  JPA  usage  in  the  field 
was  less  than  desired. 

Some  squadrons  used  the  aids  quite  extensively. 
Other  squadrons  did  not  use  them  at  all.  This  lack  of  usage 
was  the  first  concrete  evidence  of  the  importance  of  ap 
plying  the  systems  approach  when  installing  the  aiding 
concept.  This  approach  must  include  not  only  integration 
of  aiding  with  training,  but  also  proper  preparation  of 
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management,  ot  the  technicians,  and  other  interfacing 
activities. 

At  tr  e  time  of  the  program,  the  program  monitors 
though  such  preparatory  efforts  were  fringe  benefits.  They 
(Mj  not  reduce  that  the  proper  aids  were  "necessary  but 
not  sufficient."  That  is,  proper  maintenance  cannot  be 
achieved  without  effective  aids.  However,  the  aids  per  se 
will  not  improve  performance.  The  other  parts  of  the  sys¬ 
tem  (most  notably  training)  must  be  adjusted  to  realize 
the  benefit  of  the  aids. 

Air  force  Applications:  The  Air  Force  far  out  dis¬ 
tances  the  other  services  in  its  application  of  the  aiding 
concept.  At  last  report,  about  half  a  dozen  systems  are  be¬ 
ing  supported  by  aids  of  one  sort  or  another. 

Unofficial  reports  indicate  that  considerable  adapta¬ 
tions  have  been  made  by  project  personnel,  some  of  which 
have  been  counterproductive.  However,  the  most  serious 
shortcoming  is  the  fact  that  such  aids  apparently  have  not 
been  integrated  with  training.  Thus,  the  aids  serve  as  more 
usable  manuals,  but  have  not  provided  the  types  of  benefit 
possible  when  integrated  with  training  and  applied  in  a 
very  stringent  manner. 


The  Army's  effort  is  definitely  a  step  in  the  right 
direction.  However,  integration  has  to  go  far  beyond  just 
the  documentation.  The  manner  in  which  the  technicians 
are  trained,  the  work  allocation,  etc.  must  all  be  inte¬ 
grated. 

Industrial  and  other  non-DOD  applications:  In  the 
past  four  or  five  years,  Xyzyx  has  been  focusing  its  atten¬ 
tion  on  industrial  and  non-DOD  clients.  We  have  been  ap¬ 
plying  the  concept  of  integrating  aiding  and  training  for 
both  operations  and  maintenance.  We  are  usually  called  in 
to  help  fight  "fires",  but  we  also  have  had  opportunities  to 
install  such  systems  in  a  less  stressful  situation. 

Usually,  we  have  had  the  advantage  of  being  invited 
by  the  client.  Such  invitations  usually  result  from  a  man¬ 
ager  recognizing  that  a  given  personnel  performance  prob 
lem  is  related  to  some  documentation  and/or  training 
problems.  This  does  not  mean  that  all  the  relevant  parties 
greet  us  with  open  arms.  However,  by  starting  from  the 
performance  problems  of  personnel,  all  parties  are  forced 
to  look  at  the  contribution  of  documentation  and  training 
(ours  or  conventional)  to  people  performance.  In  such 
cases,  aiding  and  training  are  usually  perceived  in  a  highly 
positive  manner. 


Navy  aiding  program:  The  Navy  started  studying  the 
concept  ot  aiding  in  maintenance  in  the  early  1970's.  Un¬ 
fortunately,  the  Navy  is  still  studying  the  concept. 

As  with  the  Air  Force,  the  Navy  has  made  very  little 
change  in  its  approach  to  maintenance  training,  with  one 
major  exception.  This  exception  is  that  the  Navy  currently 
emphasizes  the  use  of  maintenance  manuals  in  its  training 
program. 

In  the  past,  training  developed  its  own  maintenance 
procedures  and  tended  to  ignore  the  maintenance  manuals. 
Today,  the  students  are  "driven"  to  the  manuals.  The 
course  essentially  leads  the  students  through  the  manuals. 
Generally,  we  wouid  agree  with  this  approach.  However, 
the  problem  illustrates  the  weakness  of  not  integrating 
aiding  with  training  from  either  direction.  The  emphasis 
on  using  manuals  in  training  has  not  really  helped  much 
because  the  manuals  are  not  usable.  Once  the  student 
leaves  the  training  environment,  the  manuals  are  put  back 
on  the  shelf  again. 

Such  emphasis  in  training  is  crucial  when  usable  aids 
are  provided.  However,  when  the  only  manuals  available 
are  conventional  manuals  with  severe  usability  problems 
such  emphasis  merely  tends  to  reduce  the  credibility  of 
training. 

Applications  in  the  Army;  The  Army  started  attend¬ 
ing  to  the  problem  again  after  the  Vietnamization  pro¬ 
gram.  The  Army  is  the  only  service  formally  integrating 
aid.ng  and  training  documentation  with  the  Integrated 
Technical  Documentation  and  Training  (ITDT)  program 
(described  in  another  paper). 


We  have  had  gratifying  successes  when  we  are  allowed 
to  integrate  with  not  only  training  but  other  interfacing 
areas  such  as  performance  standards,  certification,  ad¬ 
vancements,  etc.  Our  most  successful  application  was  ob¬ 
tained  for  a  new  plant  built  in  Ireland  to  assemble  pace¬ 
makers. 

The  standards  for  performance  were  based  on  the  per¬ 
formance  achievable  when  supported  by  aids.  Training  was 
then  designed  to  prepare  the  technicians  to  the  required 
standard,  which  required  proper  introduction  to  and  main 
tenance  of  performance  with  aids. 

Since  the  approach  was  introduced  as  an  integral  part 
of  plant  start-up,  no  acceptance  problem  occurred.  We 
realize  that  such  a  complete  approach  is  not  always  possi 
ble  in  the  military  services.  However,  the  experience,  as 
well  as  other  related  experiences  in  industrial  settings,  in¬ 
dicate  the  feasibility  of  integrating  aiding,  training,  the  set¬ 
ting  of  performance  standards,  etc. 

APPLICATION  PROBLEMS 

The  experience  gained  in  applying  the  aiding  and 
training  concepts  to  maintenance  is  quite  useful  in  plotting 
future  applications.  Probably  the  most  important  part  of 
the  experience  is  the  identification  of  pit-falls  which  we 
should  try  to  avoid  in  the  future.  Five  of  the  main  prob¬ 
lems  in  applying  aiding  and  training  in  maintenance  are 
discussed  below. 

The  Camouflage  of  "Conventionals" 

Despite  the  recent  emphasis  on  maintenance,  inade¬ 
quacies  in  maintenance  have  generally  been  ignored.  Man- 
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j-ri'u:'w  .  :>u  r'1.  itvnu.'.ui' as  the  standard.  For 

.-xdrvip.'j.  re  pe.K>rm.;i.uc  or  me  experienced  technician  is 
useo  as  e  xioi'.Ouid  .n  new  I'pie.Tiior  in  establishing  expec¬ 
tations  \.i  •  e.v  technicians.  People  tend  to  forget  that  the 
.e..v.'«i  *•  fate  o  -j  ingn  life  cycle  cost  stems  from  the 
net tunce  o’  tne  expe:  lenced  technician. 

I  dc  not  mean  to  deprecate  the  maintenance  com- 
:  uty  Most  maintenance  technicians  with  whom  I  am 

acquainted  nave  a  tremenuous  amount  of  capabilities, 
-xowever,  tney  have  essentially  an  impossible  task  to  per- 
form.  For  one.  they  are  saddled  with  maintenance  manuals 
.vc.'i  ca"'t  oe  used  except  with  extraordinary  efforts.  The 
•rai  une  they  receive  ;s  often  irrelevant  and  frequently  in¬ 
effectual.  Vet,  they  are  expected  to  keep  multi-million 
doiiar  systems  in  operation.  The  inadequacies  of  support, 
as  to  De  expected,  results  in  degradation  of  performance, 
ror  example,  measurement  of  error  rate  indicates  that  the 
proouctivity  of  maintenance  technicians  is  about  one  half 
o‘  wnat  it  can  and  should  be. 

Despite  evibence  of  inadequacies  in  performance, 
most  managers  pay  little  attention  to  the  problem.  To 
me  n,  tne  very  fact  that  manual  are  being  produced  and 
students  are  being  processed  are  evidence  that  sufficient 
attention  is  being  given  to  documentation  and  training. 
Often,  the  attitude  seems  to  be  that  with  all  that  effort 
ana  dollars  being  expended,  training  and  documentation 
can't  be  "all  mat  bad."  They  fail  to  ask  what  is  the  "return 
on  investment." 

In  other  words,  the  vast  amount  of  work  associated 
wit."  convent. onal  manuals  and  training  has  camouflaged 
me  seriousness  of  the  problem.  And  the  camouflage  has 
oeen  effective.  Since  the  system  managers  have  paid 
little  attention,  the  researchers  have  not  been  pressed  to 
3trend  to  tne  problems  either.  The  result  has  been  that 
rr. a  r  tenancy  and  its  associated  problems  of  document¬ 
ation  and  training  have  Oeen  the  "forgotten  stepchildren" 
of  systems  design. 

Resistance  of  Publications  and  Training  Management 

Unfortunately,  no  effective  performance  criteria 
neve  been  estaolished  for  publications  and  training.  As 
indicated  above,  training  tends  to  be  judged  on  the  basis 
o:  tne  number  of  students  processed  through  the  class¬ 
room.  Manuals  tend  to  be  judged  on  the  basis  of  the 
number  of  pages  produced.  Little  attention  is  given  to 
trie  usability  of  the  manuals  or  the  performance  capa¬ 
bilities  of  the  students. 

Trie  lack  of  relevant  criterion  has  created  a  situation 
wherein  there  is  no  effective  motivation  to  change.  Man¬ 
agers  of  publications  and  training  efforts  are  usually  judged 
primarily  in  terms  of  whether  they  remain  within  budget. 
Little  or  no  attention  is  given  to  whether  their  efforts  con¬ 
tribute  to  ooerational  readiness  or  other  system  criteria. 
Thus,  ,t  is  to  the  manager's  advantage  to  maintain  the 
status  quo. 

Any  deviation  from  the  status  quo  increases  the  risk 
o'  exceeding  budget.  If  a  change  is  made  and  the  techni¬ 


cians  become  more  productive,  the  publications  and/or 
training  manager  does  not  share  in  the  benefits  ■  except 
possibly  for  a  compliment.  However,  if  the  budget  is  ex¬ 
ceeded  in  the  process  of  trying  to  improve  the  situation, 
the  managers  are  chastised  accordingly. 

The  above  may  be  an  overly  harsh  assessment  of  the 
situation,  but  one  that  we  find  again  and  again  in  botb 
governmental  agencies  and  industrial  firms  Some  changes 
are  in  evidence,  but  such  changes  have  been  relatively  pain 
staking  and  slow. 

The  recent  emphasis  on  life  cycle  cost,  productivity, 
and  (in  the  DOD)  improving  operational  readiness  have 
helped  to  shake  some  people  out  of  their  lethargy.  Conse 
quently,  there  seems  to  be  a  new  awareness  of  mainte¬ 
nance  associated  problems.  As  discussed  below,  the  human 
factors  community  can  be  a  significant  contributor  to  solv 
ing  the  maintenance  problem. 

Scarcity  of  Usable  Data 

A  major  problem  for  the  practitioner  is  the  scarcity 
of  relevant  research  data.  We  agree  that  there  should  no 
longer  be  a  need  to  conduct  trade-offs  between  aiding  ana 
training.  Both  are  needed  and  should  be  integrated.  How 
ever,  there  are  various  allocation  decisions  which  must  be 
made  by  practitioners  on  a  system -by-system  basis.  For 
example,  how  much  hands-on  practice  should  be  scheduled 
in  training  if  the  technician  is  to  perform  with  aids  in  the 
field. 

The  question  of  "how  much"  hands-on  training  is  an 
especially  important  question  in  maintenance.  The  greatest 
percentage  of  jobs  assigned  to  a  maintenance  technician 
tends  to  be  jobs  occurring  at  very  low  frequency,  i.e.,  once 
or  twice  per  year  or  lesser  frequency.  In  such  cases,  will 
any  hands-on  practice  during  training  be  of  any  value? 
There  is  some  reason  to  believe  that  the  most  beneficial 
effect  of  practice  in  those  situations  is  the  confidence 
gained  (of  the  aids)  by  the  student. 

Another  allocation  decision  is  whether  to  provide  a 
generic  procedure  for  multiple  items  supplemented  by 
training,  or  a  specific  procedure  for  each  item.  There  is 
some  indication  that  such  mechanically-oriented  mainte¬ 
nance  activities  as  "remove  and  install"  and  "assemble 
and  disassemble"  can  be  effectively  supported  with  generic 
procedures  supplemented  by  training.  The  technicians  will 
still  need  aiding  support  but  the  characteristics  of  such  aid 
will  be  considerably  different  from  the  procedural  JPAs  so 
common  in  the  demonstration  studies. 

Another  area  requiring  study  is  the  rate  of  forgetting 
associated  with  different  amounts  of  practice  o*  mainte 
nance  procedures.  Such  research  is  needed  to  establish 
priorities  for  assigning  practice  sessions. 

It  is  impossible  to  provide  practice  sessions  for  all 
activities.  Certain  activities  should  require  ho  training  due 
to  the  infrequency  of  occurrence  in  the  field  Other  activ¬ 
ities  occur  so  frequently  that  most  of  the  necessary  re 
plications  for  learning  can  occur  on  the  job  However,  the 
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,  .11  n!.o  , .  •  >  u  r.jvc  s..mt  idea  of  the  maximum 

■  tviwet' i  sess.ons  which  will  inhibit  forgetting  of 
MV  ;  t  procedures 

r  t  ,bov.  .-.re  only  some  of  the  data  voids.  We  believe 
;-dt  e  i-.'.;. re  approach  to  bands- on  training  and  systems 
t- :  it.reu  to  be  supported  by  research  data. 

As  practitioners,  we  must  provide  answers  to  our 
clients  Wit-  out  tne  data,  we  are  forced  to  select  an  ap¬ 
proach  on  tne  oasis  of  judgement  only  -  or  fail  to  change 
;u->  a  conventional  approach,  For  example,  many  pro¬ 
grammers  applying  the  aiding  concept  still  provide  more 
classroom  trainmg  than  is  needed  (we  think)  since  we  do 
not  have  data  to  support  our  judgement.  This  overtraining 
tune  would  be  more  effectively  applied  to  more  relevant 
systems  and/or  nands  on  training. 

The  Professional  Researcher 

Being  a  young  discipline,  the  human  factors  com¬ 
munity  hasn't  learned  to  differentiate  between  research 
and  applications.  We  have  found  that  it  takes  entirely  dif¬ 
ferent  skills  to  be  a  successful  researcher  as  compared  to 
being  a  successful  practitioner,  in  many  cases,  characteris¬ 
tics  contributing  to  successful  research  are  counterproduc¬ 
tive  m  an  applied  setting. 

Part  ot  the  reason  why  many  promising  human  fac¬ 
tors  areas  '  jve  not  borne  as  much  fruit  as  it  could  is  the 
running  conflict  between  the  researcher  and  the  practi- 
:".iner.  Tnere  are  many  researchers  who  "aabble"  in  appli¬ 
cations  Seen  researchers  tend  to  apply  research  criteria 
for  applied  problems.  This  often  results  in  recommend¬ 
ations  to  study  the  problem  some  more,  and  never  quite 
helping  o-ganizations  solve  their  problems. 

Lack  of  Integration  of  Aiding  and  Training 

This  conference  should  be  very  helpful  in  "spread¬ 
ing  tne  word"  foi  integrating  aiding  and  training.  Current- 
iv  integration  of  documentation  and  training  is  more 
rhetoric  than  action.  I  believe  the  lack  of  integration 
•icoi-ei  to  noth  the  research  community  as  well  as  the  prac- 
titionp'S. 

Tne  genera;  conflict  oetween  publications  and  tram- 
•  ng  groups  is  fairly  well  publicized  Unfortunately,  such  a 
conflict  aiso  exists  between  aiding  researchers  and  training 
researchers  despite  protest  to  the  contrary  by  the  re¬ 
searchers 

Tram.ng  researchers  tend  to  distrust  the  aiding  re¬ 
searchers  because  the  latte r  seem  to  want  to  eliminate 
t'aming.  in  turn,  tne  aiding  researcher  tends  to  aggravate 
this  nstrust  by  overzealous  selling  of  the  aiding  concept. 

Aiding  jirt  training  in  maintenance  represents  an 
ovorirtuoity  for  the  human  factors  community  to  make  a 
Significant  contnoution.  To  do  so.  the  types  of  pitfalls 
mentioned  above  should  be  avoided.  Some  suggestions  to 
help  do  sc  are  discussed  below. 


SUGGESTIONS  FOR  APPLYING  AIDING 
AND  TRAINING  IN  MAINTENANCE 

Being  a  practitioner,  my  suggestions  for  applyino 
aiding  and  training  in  maintenance  tend  to  be  heavily 
biased  in  favor  of  applications.  I  believe  application  is 
one  of  the  primary  needs  of  the  human  factors  com¬ 
munity  at  this  time,  although  more  research  is  also  sorely 
needed.  Unfortunately,  justification  for  such  research 
tends  to  be  weak  without  a  competent  applications  pro¬ 
gram. 

Develop  a  Group  Specializing  in  Application  Within  Each 
Service 

Currently,  there  appears  to  be  no  one  in  charge  of  or 
apparently  interested  in  an  integrated  application  of  aiding 
and  training.  In  fact,  integrated  application  of  human  fac 
tors  variables  tends  to  be  inhibited  by  the  specialization  of 
research  centers,  e.g.,  centers  for  training,  hum  engineer 
ing/design,  personnel,  etc. 

Part  of  the  problem  results  from  confusing  applic¬ 
ation  with  research.  That  is,  research  is  understandably 
organized  around  such  functional  areas  as  training,  human 
engineering/design,  personnel,  etc.  Application  requires  the 
consideration  of  data  from  all  of  these  areas.  This  inte¬ 
grated  application  is  especially  needed  in  maintenance. 
Yet,  research  centers  hesitate  to  go  beyond  the  functional 
boundaries  of  the  center.  Consequently,  solutions  to  prob¬ 
lems  tend  to  be  highly  biased  in  favor  of  the  center  s 
specialty, 

In  addition,  there  needs  to  be  a  more  effective  bridge 
between  the  research  community  and  the  systems  develop 
ment  community.  That  is,  someone  has  to  bridge  the  cur¬ 
rent  gap  between  (1)  the  researchers  in  training,  aiding, 
personnel  and  human  engineering,  and  (2)  the  various 
groups  involved  in  developing  systems  such  as  design 
engineering,  publications,  training  centers,  etc. 

Evidence  to  date  indicate  that  research  centers  are 
not  properly  organized  to  respond  to  system  needs,  in 
addition,  researchers  are  generally  not  inclined  to  attend  to 
application-type  problems,  neither  individually  nor  as  a 
group.  I  believe  significant  advancements  in  applving 
human  factors  variables  can  be  made  by  a  group  special¬ 
izing  in  applications. 

This  group  would  develop  specifications  and  guide¬ 
lines  to  be  used  in  system  development/refinement  pro¬ 
grams.  Also,  the  group  would  communicate  voids  and  re¬ 
search  needs  to  the  research  community. 

Some  centers  have  tried  to  establish  such  a  group. 
However,  success  has  been  quite  limited  because  the  group 
is  treated  more  as  a  necessary  evil.  The  group  is  seldom 
given  any  stature,  get  limited  support  from  the  researchers, 
and  usually  operate  with  a  very  limited  budget. 
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Select,  Develop  and  Encourage  Practitioners 

T  ,  ,,  olessv-njis  required  to  properly 

piett^nt  the  systems  application  group  are  practitioners, 

,  resee--;  ne-s  Currently,  appiieu-onented  researchers 
ter. a  to  be  ut  a  disadvantage  ,n  a  research  community. 
They  tend  to  be  looked  upon  as  iess  o^u  protessional  than 
a  'esearche:  Usually,  such  an  applied  oriented  researcher 
tends  to  get  less  support  and  encouragement  at  a  research 
Center.  Given  such  an  environment,  it  is  not  surprising  to 
r.nc  th„t  the  centers  no  not  spawn  very  many  practition¬ 
ers.  Yet,  those  who  have  successfully  overcome  such 
barriers  tend  to  oe  very  good  practitioners. 

I  beneve  both  application  and  research  would  be 
greatly  aided  by  more  trained  practitioners.  When  housed 
n  a  systems  application  group,  tneir  effectiveness  could  be 
considerable  both  for  the  systems  affected  as  well  as  the 
researen  community  and  such  functional  groups  as  tech¬ 
nical  publications,  training  centers,  etc. 

Involve  Practitioners  in  Planning  Applied  Research  Pro¬ 
grams 

Most  appliea  research  programs  tend  to  depend 
primarily  upon  the  researcher's  perception  of  the  needs. 
The  researcher's  view  of  the  world  tends  to  be  consider¬ 
ably  different  from  the  practitioner's  view.  Thus,  such 
applied  research  programs  often  "miss  the  target,"  i.e., 
fail  to  provide  data  which  are  useful  to  practitioners.  The 
research  programs  in  aiding  and  training  in  maintenance  is 
no  exception. 

The  practitioner's  needs  should  be  considered  in  de¬ 
veloping  applied  research  programs.  This  can  be  accom¬ 
plished  by  such  accepted  mechanisms  as  workshops,  sur¬ 
veys,  or  an  Ad  Hoc  committee. 

Apply  the  Systems  Approach  in  Planning  an  Application 
Program  for  Aiding  and  Training  in  Maintenance 

In  order  to  realize  the  full  potential  of  aiding  and 
training  m  maintenance,  the  concept  needs  to  be  applied 
waely,  as  well  as  effectively.  Often,  such  wide  applications 
(especially  in  a  limited  bme  period)  result  in  mass  confu¬ 
sion  whicn  in  turn  severely  dilutes  tne  effect. 

The  systems  approach  should  be  very  useful  in  devel¬ 
oping  an  objective  and  properly  integrated  effort.  Thisap 
o'oacn  would  include  proper  definition  of  the  objectives 
for  the  program,  derivation  of  requirements  for  sub-pro¬ 
grams,  design  of  sub-programs  to  meet  the  requirements, 
and  standards  for  measurement. 
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THE  NEED  FOR  A  PERSONNEL  SYSTEMS  VIEWPOINT  IN  THE 
DESIGN  OF  IMPROVED  MAINTENANCE  TRAINING 

R.  E.  Blanchard 

Navy  Personnel  Research  and  Development  Center 
San  Diego,  California 


ABSTRACT 

Successful  development  of  a  maintenance  training  improvement  program  re¬ 
quires  the  inclination  and  capacity  to  perceive  the  problem  from  a  personnel  sys 
terns  viewpoint.  It  anticipated  payoffs  are  to  be  realized,  interfaces  among  the  various 
system  elements  must  be  appraised  jointly  from  a  cost  tradeoff  standpoint.  This  pre¬ 
mise  is  particularly  true  for  maintenance  training  which  is  one  of  the  more  expensive 
and  risk  inherent  investments  in  present  day  personnel  systems  In  response  to  the 
need  tor  a  personnel  systems  design  framework,  the  Integrated  Personnel  Systems  Ap¬ 
proach  (IPSA)  was  devised  which  includes  a  tradeoff  analysis  model.  IPSA  was  then 
used  to  evolve  a  personnel  system  concept  called  EPICS  for  Enlisted  Personnel  Indi¬ 
vidualized  Career  System.  EPICS  includes  such  features  as  enriched  and  hybrid  job 
performance  aids,  deferred  pre-assignment  training,  individualized  career  advance 
mem,  integrated  shorebased  and  shipboard  training,  alternative  skill  acceleration  and 
lob  enlargement  training  paths,  and  transition  adaptation  training.  It  is  recommend¬ 
ed  that  an  approach  like  IPSA  be  employed  along  with  increased  sensitivity  to  the 
personnel  system  viewpoint  within  professional  and  organizational  communities  in 
order  that  our  steadily  decreasing  personnel  resources  may  be  employed  more  effec¬ 
tively. 


INTRODUCTION 


The  Problem 

Currently,  the  Navy  and  other  services  are  faced  with 
increasing  maintenance  training  costs,  shrinking  budgets 
and  declining  entry  level  skills  along  with  unfavorable  at¬ 
trition  and  personnel  dissatisfaction.  With  steadily  increas¬ 
ing  hardware  complexity,  existing  personnel  systems  are 
constantly  challenged  to  provide  resources  that  can  fulfiil 
operational  and  maintenance  requirements  at  an  affordable 
cost  At  present,  nearly  60  percent  of  total  life  cycle  costs 
are  attnputabie  to  personnel  (U.  S.  Commission  on  De¬ 
fense  Manpower,  1976).  The  relative  costs  of  training  are 
sufficiently  high  to  attract  the  attention  of  the  OMB  and 
me  GAO. 

Clearly,  traditional  approaches  to  personnel  develop 
ment  must  be  scrutinized  closely,  and  other  approaches 
and  concepts  for  utilizing  our  personnel  resources  identi 
*.ed  and  appraised.  The  scope  and  urgency  of  the  problem 
demands  new  initiatives  and,  particularly,  innovative  thmk- 
3  with  respect  to  utilizing  availabe  technology  that  might 
be  brought  to  bear  on  the  problem. 


Traditional  Approach 

In  the  past,  selection,  assignment,  and  training  have 
been  the  preferred  approaches  for  producing  the  people 
resources  required.  Training  typically  is  given  maioi  em 
phasis,  to  the  extent  that,  today,  relatively  huge  training 
investments  are  made  in  personnel  before  they  have  an 
opportunity  to  demonstrate  their  aoaptability  to  ship 
board  life  or  their  on-the-|Ob  proficiency.  Loss  rate  pi. or 
to  EAOS  for  these  first-term  enlisted  Personnel  is  about 
42%  with  an  85%  turnover  at  the  end  of  their  fi-st  em-st 
ment  (CNET  Report  to  CNO,  19781  The  cost  of  p'osio.ng 
maintenance  training  for  those  personnel  approaches 
$30,000  per  moividual  (CNET  Letter,  1978) 

Such  an  approach  is  clear  »  rot  cost  effective  Tra  n 
ing  is  an  important  ana  vital  means  tor  developing  the  levo 
o ■  skills  and  knowieage  needed  'o-  the  more  advanced 
technical  jobs,  particularly  for  the  career  force  However 
there  is  substantial  evidence  that  heav,  "bont  end  loader1 
t-aining  is  not  the  most  cost  effective  route  to  tounw  ,n 
preparing  recruits  for  then  first  technical  |ob  in  the  fieet 
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.  . . .  .i'O.v di, .c's  adaptability 

s.-.  fj  ,  / ,  rur  '■  „C  :  -niut'r  before  such 

i.i'j:  . v t  : : .  ['.it:.  .»r,  .’\s  v  b:.:a:d  .-morht-r  wav.  We  need 
■  »;,■*,’!  ...  .vestments  n  [: ainin-j  art, I  such  time 

‘x  sa.-;,  c-ncerpiny  expected  payoffs  can  oe  sub 

.ne  stmonts  '  formal  training  is  not  tne 
.  •  ,-u; . .  a  *uo  optimum  apptoacn  to  problem  solu- 
i,..-.  A  jtui  Cans,  cf.tr  app'oaches  generated  to  relieve  trie 
PiOPieiT.s  note  :  above  have  addressed  only  specific  aspects 
ei  tne  lOtai  personnel  system.  Tnat  is,  we  tend  to  see  the 
lob.c;  as  a  "se.ecticn  problem"  or  a  "training  problem" 
li  "retention  problem  "  We  seldom  nave  the  inclination  or 
ms.ght  to  perceive  such  problems  as  a  set  of  Interrelated 
symptoms  of  3  personnel  system  problem. 

A  Mjriticdr.i  exampie  of  what  can  result  from  tne 
a  •  of  a  system’s  v.cwpomt  was  reported  in  a  study  by 
■  ...'Sen  ,'97/'  .  „o:  auis  were  introduced  into  an  existing 
system  w.tr.out  due  regard  for  interaction  with  job  design, 
caret  •  a  Ivance  nen r,  training,  or  organisational  structure. 
T"  :■  sub;ec;s  soon  became  anomalies  since  they  were  con- 
leied  unacceptable  for  assignment  to  many  job  tasks 
.or  w  ..  n  jPAs  were  avanabie,  rejected  by  supervisors  and 
rum  aPA  jr. anted  peers,  and  were  unable  to  pass  knowl- 
et:je  based  tests  for  advancement  in  rank  even  though  they 
were  satisfactorily  performing  the  jobs  under  study.  As 
erne  m.ght  expect,  severe  personnel  turbulence  resulted  and 
potert.j,  benefits  trom  the  use  of  job  aids  were  lost. 

Aimoegr  :-.e  concept  of  system  has  been  wifh  us  for 
over  2b  yea-s,  there  still  exists  certain  factors  which  tend 
to  preclude  or  at  least  dimmish  its  full  consideration.  That 
a  certain  amount  of  tunnel  vision  exists  perhaps  should  not 
ue  surnnsing.  Our  professional  and  organizational  struc 
tares  tend  to  direct  our  viewpoints  in  a  parochial  manner. 
Melton  1 1962!  noted  that  the  psychotechnologies  associ¬ 
ated  with  personnel  Selection,  training,  and  human  engi¬ 
neering  were  developed  more  or  less  in  isolation  from  one 
urotner.  Different  specialists  fended  to  promote  their  spe¬ 
ll  ./ my  more  than  me  integration  of  specialities.  Hence, 
tr  ose  m  tne  training  establishment  tend  to  see  most  per¬ 
sonnel  prob.ems  with  solutions  through  new  instructional 
technology  innovations,  while  our  colleagues  from  the 
selection  ana  placement  realm  would  like  to  answer  the 
problem  with  a  new  selection  test. 

The  most  significant  inhibitor  to  the  systems  ap- 
proacn  has  been  the  management  organization  employed 
oy  m.,-  military  and  industry  for  the  development  and  use 
hi  ho  dware  systems  This  is  particularly  acute  in  the  Navy 
where  the  various  elements  of  the  personnel  system  are 
-.ompartmentefl  m  as  many  bureaus  and  offices.  No  force 
iaS  been  available  to  date  to  achieve  an  effective  integra 
tint  of  tnose  elements.  In  the  research  and  development 
.rimmunity,  our  efforts  are  largely  directed  by  the  label 
attached  to  our  organizational  unit,  or  by  the  particular 
Mie  land  funding  source)  associated  with  the  program 
•ner, lent  wh,ch  constitutes  our  job.  Hence,  we  tend  to  be 
predisposed  toward  applying  the  associated  technology. 


In  itst.f,  a  singular  approach  toward  the  solution  of 
a  personnel  problem  is  not  necessarily  inappropriate  as 
long  as  the  interaction  of  that  particular  element  with 
other  system  elements  is  considered  and  evaluated.  Most 
often  though,  we  proceed  with  a  singular  solution  oblivi 
ous  to  significant  negative  impacts  with  other  system  ele 
ments  or  of  opportunities  to  greatly  enhance  the  payoff 
of  our  particular  approach  by  optimizing  its  relation  with 
other  system  elements.  An  additional  failing  of  the  singular 
approach  is  that  the  nature  of  the  real  problem  is  seldom 
thoroughly  understood  without  the  broader  viewpoint  of 
the  systems  approach. 

Background  and  Intent 

We  have  a  program  at  NPRDC  which  began  with  the 
objective  of  evaluating  the  cost  effectiveness  of  various 
mixes  of  job  performance  aids  in  the  fleet.  Our  first  step 
in  the  program  was  to  convene  an  invitational  conference 
to  discuss  the  state-of-the-art  in  JPA  technology  and  to 
become  aware  of  any  implementation  problems  (see 
Booher,  1977,  for  the  proceedings). 

As  a  result  of  that  conference,  it  became  obvious  that 
our  orientation  had  to  be  broader  than  just  job  aids  and 
training.  The  need  for  a  total  systems  approach  was  vividly 
clear.  As  a  result,  we  subsequently  assembled  a  technique 
we  call  the  Integrated  Personnel  Systems  Approach 
(IPSA).  Using  IPSA,  we  evolved  over  time  an  experimental 
personnel  system  called  the  Enlisted  Personnel  Individual 
ized  Career  System,  or  EPICS. 

The  intent  of  this  paper  is  to  discuss  the  basis  for 
IPSA  model  development  and  use  and  to  report  on  the 
characteristics  of  EPICS.  It  is  believed  that  IPSA  applica 
tions  within  the  realm  of  improved  maintenance  training 
initiatives  are  indeed  extensive. 

INTEGRATED  PERSONNEL  SYSTEM  APPROACH 

It  is  not  the  intent  here  to  belabor  the  reader  with  yet 
another  philosophical  exploration  of  the  term  "system." 
The  intent  is  to  outline  a  brief  and  hopefully  useful  frame¬ 
work  for  relating  the  Integrated  Personnel  System  Ap 
proach  (IPSA)  to  the  conception,  design  and  development 
of  personnel  systems.  Figure  1  is  a  graphic  depiction  of  the 
system's  concept. 

Definition  of  System 

First,  the  definition  of  a  system  is  to  a  large  extent 
arbitrary  and  it  can  usually  be  said  that  what  is  one  per 
son's  system  Is  another  person's  subsystem,  that  is,  there  is 
a  hierarchical  relation  between  system  levels  interrelated 
by  underlying  primary  goals,  For  example,  a  Navy  person 
nel  system  might  be  considered  to  be  embedded  in  a  large, 
supra  system  called  the  Navy  warfare  system  Most  of  us 
are  familiar  with  the  concept  of  a  "man-machine"  system, 
promoted  by  the  human  factors  community.  Hardware  is 
important  to  the  personnel  system  concept;  however,  the 
orientation  is  to  consider  simultaneously  the  requirements 
of  all  Hardware  systems  on  an  on  going  basis  and  not  |ust  a 
single  man-machine  system  design  event. 
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PERSONNEL 

SYSTEM 

GOALS 

- 1 - 


|  INTERNAL  SYSTEM  ENVIRONMENT 


I  SYSTEM  ELEMENTS 


SYSTEM  MISSIONS  •  SUBGOALS 


FIGURE  1.  Taxonomy  of  a  Personnel  System 


Taking  the  lead  from  Fitts  ( 1 959) ,  the  following  def¬ 
inition  of  "system"  is  offered  "An  assemblage  of  elements 
engaged  in  a  mutual  striving  for  a  common  goal(s)  tied  to¬ 
gether  by  an  interactive  flow  network  where  the  output  of 
the  system  is  a  function  uf  the  characteristics  of  th«'  ele 
ments  and  of  »heir  interrelations." 

Accordmq  to  Meister  and  Rabideau  T'9Cd  3  \*sterr> 
can  be  characterized  by  the  following  taxonom  e  -ms 

System  Goals 

Pr.mary 

Secondary 

Environment 

External 

Internal 

Elements 

Missions 

Functions 

Each  of  these  terms  is  explored  briefly  below 

System  Goals.  A  primary  discriminating  feature  of  a 
given  system  is  its  goal  or  purpose.  Goals  may  be  either 


primary  or  secondary  Primary  goals  relate  directly  to  ac 
complishing  the  system's  basic  missions.  Secondary  goals 
are  tied  to  supporting  elements  and  are  directed  to  insuring 
that  tht-  integrity  of  the  system  can  be  maintained  so  as  to 
fulfill  tne  primary  goals.  It  should  be  noted  that  made 
u^a'.e  approaches  to  fulfilling  secondary  personnel  system 
goals  (motivation,  morale,  job  satisfaction,  retention)  and 
thereby  tuning  to  maintain  system  integrity  can  result  in 
svstt.m  operational  degradation  and  ultimately  to  system 
faiiu'n 


The  pr.mary  goal  of  a  personnel  system  iS  to  acquire, 
develop,  support  and  sustain  the  necessary  human  re¬ 
sources  to  meet  the  required  qualitative  and  quantitative 
personne'  and  performance  requirements  imposed  by  the 
'■yaw's  warfare  and  support  systems.  Subgonis  relate  to 
(a)  meeting  the  requirements  of  new  hardware  systems,  (b) 
responding  to  modifications  and  updates  of  existing  hard¬ 
ware  systems,  and  (c)  dealing  with  perturbations  within 
the  personnel  system's  internal  environment. 

Environment.  A  system  has  both  an  external  and  an 
internal  environment.  The  external  environment  estab 
i ishes  boundaries  around  the  system,  and  defines  what  con 
stitutes  the  system  by  identifying  those  objects  excluded 
from  the  system  and  those  that  are  included  in  the  system. 
For  example,  in  the  definition  of  a  personnel  system,  the 
hardware  systems  with  which  the  personnel  system  inter 
acts  is  a  part  of  the  external  environment.  The  internal 
environment  consists  of  those  elements  which  make  up 
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:;■(  y^ief  -.  i-.  ;  i  nvi  -sources.  training  elements, 

yj- ’  w  1  t.i.  I;,,  'RjPjijemiir.!  structure,  and  so 

‘..i"  :  .-.v  :a-'owI.  J  he  x>,.nuarv  between  the  system's 

A'lcu1  j  •  iti'rnji  fits ironments  can  be  quite  loose.  The 
jitce  yt  mjintdinmy  the  internal  environment  is 
vaotiu  or.y  to  the  system's  primary  mission. 

To  r^  iage  itself  properly,  the  system  must  be  able  to 
sense  the  effects  uf  its  actions  on  the  external  environment 
anu  to  respond  to  tr-ose  effects  accordingly.  This  implies 
tne  ex. stance  of  a  well-developed  and  continuously  opera¬ 
ting  feedback  mechanism.  As  a  part  of  the  feedback  pro¬ 
vision,  the  system  must  be  able  to  recognize  when  the 
integrity  of  its  internal  environment  has  been  compro¬ 
mised  and  be  able  to  restore  itself. 

System  Elements.  System  elements  compose  the  sys¬ 
tem  and  provide  the  means  for  its  operation.  For  example, 
a  nonexhaustive  set  of  possible  personnel  system  elements 
might  include: 


missions.  For  example,  relating  missions  to  system  goals 
noted  above,  one  system  mission  might  be  to  fulfill  the 
personnel  system  needs  of  a  new  surface  ship  platform,  or 
a  new  weapons  system  being  installed  on  a  current  ship. 
Or,  a  mission  could  involve  responding  to  a  subgoal  assoct 
ated  with  the  existing  personnel  system's  internal  environ¬ 
ment  to  protect  against  loss  of  its  integrity,  such  as  an  un 
acceptably  high  first-enlistment  attrition  rate.  The  mission 
the  personnel  system  is  to  fulfill  also  establishes  the  stan¬ 
dards  for  system  performance;  that  is,  the  objectives  to  be 
met  stem  from  the  specific  mission  to  be  performed. 

Functions.  Personnel  system  functions  describe  the 
manner  in  which  system  missions  and  ultimately  system 
goals  will  be  achieved.  The  function  is  the  "how"  of  sys¬ 
tem  operation  and  it  relates  directly  to  a  particular  system 
element.  For  example,  a  set  of  functions  which  might  be 
associated  with  a  personnel  system  includes: 

Search  Communication/Control 


Personnel  Resources 


Acquisition 


Training 


Occupational  Structure  (Job  Design) 

Training  &  Education  (shorebased,  shipboard, 
etc.) 

Performance  Aids 
Career/Advancement  Structure 
Procedures/Rules 
Organizational  Structure 
Technical  Data 

Control/Management  Structure 
Support  Elements 
Technology  Development 

A  critical  point  here  is  that  to  have  a  true  system,  the 
elements  must  be  interactive.  It  may  be  that  some  ele¬ 
ments  are  treated  as  dependent  variables  and  others  as  in¬ 
dependent  variables  and  this  may  change  depending  upon 
the  nature  of  the  particular  system  goal  addressed.  But 
interaction  is  imperative.  For  example,  the  training  ele 
mem  must  not  be  treated  independent  from  the  personnel 
resource  element,  the  job  structure  element,  or  the  per 
formance  aiding  element.  A  set  of  elements  working  in¬ 
dependently  without  interaction  and  feedback  loops  does 
not  constitute  a  system  since  there  is  no  mutual  striving 
toward  a  common  goal. 

Missions.  Missions  are  subsets  of  system  primary 
goals.  Establishing  mission  obiectives  provides  for  defining 
a  specific  system  goal  and  facilitates  the  more  precise  de 
veiopment  of  a  system  to  meet  those  goals.  Any  personnel 
system  would  have  the  capacity  to  meet  several  types  of 


Screening 

Assignment 

Advancement 

Supervision 

Administration 

Compensation/Reward 


Education 
Aiding  (JPAs) 
Evaluation 
Distribution 
Support 


Personnel  System  Development 

The  prior  discussion  concerned  the  definition  of  a 
personnel  system  and  its  components.  This  section  con 
cerns  the  application  of  those  constraints  in  the  concep¬ 
tion,  design,  development  and  evaluation  of  a  personnel 
system  concept.  Figure  2  provides  a  graphic  description  of 
this  process. 


A  primary  input  to  the  system  development  model  is 
the  requirements  and  objectives  derived  from  system  goals 
and  associated  with  the  mission  of  interest.  In  some  in¬ 
stances  the  mission  will  be  defined  by  several  hopefully 
congruent  objectives  or  subgoals,  such  as  "provide  the 
necessary  levels  of  personnel  capabilities  without  increas 
ing  manning  levels  or  training  costs."  Or,  the  objectives 
might  relate  to  internal  environment  problems,  as  noted 
earlier,  and  concern  high  turnover,  skill  degradation  over 
time,  or  ambiguous  advancement  channels. 

Equally  important  to  the  development  is  identifica 
tion  and  analysis  of  the  constraints,  limitations,  and  as 
sumptions  within  which  the  design  must  be  conceived 
These  factors  are  not  an  actual  pan  of  the  system  but  they 
nonetheless  play  an  important  role  in  its  design  and  opera 
tion.  Examples  are  (a)  operating  environment,  (b)  hard¬ 
ware  system  interface  complexity,  (c)  available  manpower 
and  skill  levels,  (d)  funding,  (e)  technological  gaps  or  lag. 
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FIGURE  2.  Application  of  Integrated  Personnel  System  Approach 


ana  (f)  time  schedule.  There  are,  of  course,  numerous  such 
variables  whicn  iimit.  moderate  and  constrain  the  various 
system  design  concepts  which  might  be  conceived. 

An  important  aspect  of  the  IPSA  concerns  the  joint 
consideration  ot  personnel  system  elements  (at  least  those 
most  relevant)  within  the  pattern  of  constraints  extant  to 
achieve  the  stated  system  objectives.  An  important  feature 
of  this  procedure  is  the  capacity  to  conceptualize  various 
approaches  to  the  problem  through  alternative  system  con¬ 
cent  developments.  This  provides  the  designer  a  powerful 
looi  by  which  he  can  explore  various  ideas  for  utilizing 
system  elements  for  a  particular  set  of  objectives  and  con¬ 
straints.  As  illustrated  in  Figure  2,  several  alternative  con¬ 
cepts  or  variations  may  be  identified.  The  problem  here  is 
that  all  system  concepts  cannot  be  developed  and  imple¬ 
mented  to  test  their  relative  ability  to  meet  mission  ob¬ 
jectives.  This  must  be  done  analytically,  at  least  in  most 
instances.  IPSA  includes  the  use  of  a  tradeoff  analysis 
model  to  explore  and  contrast  the  various  system  ap¬ 
proaches.  This  model  is  currently  under  development  at 
NPRDC  with  a  preliminary  edition  due  to  be  completed 
shortly 

As  usual,  the  utility  of  the  tradeoff  model  currently 
is  limited  to  lack  of  objective  data  to  explain  quantitative¬ 
ly  the  interrelation  among  the  numerous  variables.  How¬ 
ever,  even  jsmg  simple  algorithms  (see  Booher,  1978),  one 
can  predict  the  direction  of  influence  (positive  or  negative) 
on  the  evaluation  criteria  selected  for  relative  appraisal  of 
system  approaches.  However,  with  the  availability  of  nec¬ 


essary  functional  data  and  computer  program,  the  power 
of  the  model  as  an  integrated  personnel  system  design  tool 
will  be  greatly  increased.  An  example  of  a  current  question 
we  would  like  to  explore  using  the  model  concerns  the  re¬ 
lative  saving  in  training  resources  (particularly  shipboard) 
through  the  use  of  enriched*  job  performance  aids. 

APPLICATION  OF  IPSA 

The  Integrated  Personnel  Systems  Approach,  outlined 
previously,  was  employed  to  develop  an  innovative 
nel  system  concept  where  joint  consideration  wa.  . 
primary  system  elements.  A  brief  description  of  the  ap¬ 
proach  taken  and  the  result  follows. 

Goals  and  Objectives 

The  primary  goal  of  the  system  development  was  to 
improve  the  material  readiness  of  Navy  electronics-based 
systems  through  enhanced  effectiveness  of  the  first  enlist 
ment  manpower  force  at  an  affordable  cost.  Secondary 
goals  or  objectives  included: 

1)  Identify,  appraise,  and  implement  any  available 
personnel  system  technologies  which  would  act 
to  reduce  current  equipment  maintenance  costs 
and  improve  system  availability. 

2)  Reduce  the  current  investment  in  shorebased 
formal  maintenance  training  provided  prior  to 
first  duty  assignment.  Allow  for  redistribution 
of  maintenance  training  resources. 


*  Refers  to  JPAs  with  instructional  information  integrated  with  the  usual  procedural  data. 
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oi  r*  ;or  i. ipro v't'U  utilisation  ot  “lesser-apti- 

MUr  personnel  (i.e.,  those  who  currently  are 
consider eu  "non  school  eligible”). 

Mi  ir.'y  and  counter  those  characteristics  of  the 
ioPv.-.i  personnel  system  that  contribute  to  de- 
not  vation,  personnel  turbulence,  tailed  expec¬ 
tations  and  attrition. 

5)  ensu  e  tnat  enlistees  have  t.ne  opportunity  to 
obtain  a  credible  amount  of  technical  training 
that  is  transferable  to  civilian  life  during  the  first 
four-year  enlistment. 

The  EPICS  Concept 

Considering  the  goais  and  objectives  above  and  em- 
p.oying  the  IPSA,  a  personnel  system  concept  was  evolved 
called  EPiCS,  "Enlisted  Personnel  Individualized  Career 
System."  A  graphic  depiction  is  provided  in  Figure  3.  A 
b-'-ef  description  of  its  structure  and  provisions  follows. 
For  a  more  detailed  discussion,  review  of  two  NPRDC 
oocuments  is  recommended  (Blanchard  and  Laabs,  1978; 
3ianchard  and  Smillie,  1979). 


The  primary  path  of  the  model  is  depicted  by  the 
horizontal  left-to  right  flow.  An  acceleration  path  pro 
ceeds  through  skills  preparation  events  to  formalized 
skills  training  ashore.  Remediation  loops  are  provided 
at  the  various  screen/assessment  events  to  provide  addi 
tional  opportunities  for  reevaluation  and  entry  into  the 
mam  career  path  should  individual  assessment  be  negative. 
The  job  enlargement  paths,  which  parallel  the  main  career 
path  give  individuals  expanded  reponsibilities  at  specified 
skill  levels  with  the  continued  opportunity  for  entry  into 
the  main  career  path  when  qualifications  are  met. 

The  model  shown  is  directed  primarily  at  four  year 
obligors  with  the  provision  for  a  two-year  extension  to 
qualify  for  system  technical  training  ashore.  It  is  antici 
pated  that  maximum  effect  of  the  EPICS  model  would  be 
realized  with  mental  group  Category  IIIA  and  IIIB  individ 
uals.  Some  payoff  could  be  realized  from  Category  II, 
however,  competition  for  upper-level  resources  would 
probably  cause  a  truncation  around  an  AFQT  score  of  70. 

Three  primary  skill  levels  are  proposed  for  purposes 
of  personnel  organization  and  progression  during  the  first 


JOB  ASSIGNMENT 
SKILL  LEVEL  III 
GRADES  1.2.3 
|28  MOSI 


<*>■ 


-  ASSESSMENT 
--  SHIP/SNORE  TRANSFER 


FIGURE  3.  Enlisted  Personnel  Individualized  Career  System  -  EPICS 
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six  years  c'  service  ill  apprem.ce  technician  (novice), 
(2)  subsystem  technician  (intermediate),  and  (3)  system 
nvhiiiLi.m  (advanced).  A  fourth  sk.ll  level  that  might  be 
oseo  ,s  "Master  Technician."  Within  each  skill  level  three 
arade;  are  proposed  to  provide  tor  rather  immediate  re- 
ward  appropriate  to  increased  responsibility  and  profi 
cipncy. 

EPICS  incorporates  tnc  "deferred  training"  concept 
ir.  wruch  the  recruit  is  sent  to  sea  after  apprentice  seaman 
training  for  a  shipboard  orientation  period  of  from  six  to 
t.ght  montns,  depending  upon  ship  deployment  schedules. 
The  dea  here  is  to  get  the  individual  or,  the  job  as  quickly 
as  possible  and  ensure  that  he  is  contributing  effectively  to 
snip’s  work  witn  limited  initial  investment  in  formal  train¬ 
ing. 

Deferred  training  is  supported  by  job  performance 
aids.  Note  that  we  are  deferring  training,  not  eliminating 
it.  The  samt  levels  of  technical  training  would  be  required, 
out  delivery  would  be  distributed  across  the  individual's 
term  of  obligated  service.  At  first,  the  investment  is  made 
,n  toe  "book",  later,  after  the  individual  has  demonstrated 
n.s  adaptability,  interest,  and  motivation,  the  investment 
shifts  to  the  "head"  via  technical  training. 

JPA  support  is  highest  during  At-Sea  Orientation  and 
Sk ill  Level  I  work.  Following  Subsystem  Technical  Train¬ 
ing.  25  to  30  months  of  service  for  an  individual  who  has 
progressed  tnrough  the  skills  acceleration  path,  emphasis 
pn  getting  the  |ob  done  with  JPAs  will  have  shifted  signifi¬ 
cant',  v  to  emphasis  on  training  to  develop  the  individual  as 
a  potential  career  force  member. 

Other  provisions,  features  and  characteristics  of  the 
EPICS  concept  include: 

i)  Training,  experience,  and  promotion  paths  are 
designed  so  that  a  path  for  advancement  is  al¬ 
ways  available  to  a  motivated,  deserving  individ¬ 
ual.  This  feature  provides  for  acceleration 
through  the  system  of  those  individuals  consid¬ 
ered  career  force  candidates.  Also,  it  ensures  the 
opportunity  for  technical  training  to  a[l  enlist¬ 
ees,  not  just  to  those  labeled  "school  eligible"  as 
determined  by  written  tests. 

2i  Transition  adaptation  training  is  included  as  a 
part  of  Apprentice  Seaman  Training  and  At-Sea 
Orientation  to  provide  the  recruit  with  the  skills 
to  help  him  cope  with  the  transition  to  military 
life,  and  particularly  to  life  aboard  ship. 

3)  An  EPICS  Sailor's  Handbook  is  envisioned 
which  will  detail  the  various  career  progression 
and  training  paths  within  the  system  along  with 
qualification  standards.  Using  this  handbook, 
each  sailor  can  plan  his  own  individualized  Navy 
career.  If  he  is  frustrated  at  some  point,  other 
avenues  available  to  him  are  clearly  defined 
which  should  help  relieve  the  "dead  end"  syn¬ 
drome.  Job-based  performance  tests  would  be 


used  to  assess  the  individuals'  progress.  Written 
tests  would  be  used  only  when  retained  knowl 
edge  of  principles,  concepts  or  procedures  was 
important  to  job  performance  (e.g.,  beginning 
at  Skill  Level  II  with  more  emphasis  at  Skill 
Level  III). 

4)  Intermediate  assessment  points  are  included 

which  provide  for  identifying  exceptional, 
highly  motivated  performers  who  can  be  chan 
neled  into  accelerated  training  paths  to  achieve 
early  utilization  of  available  resources.  A  corol 
lary  is  a  provision  to  identify  '  ..jr*-.  whose 

performance  is  inadequate  and  u.  pro,  de  for 
referral  to  remediation  program  or  fcr  reas 
signment. 

5)  During  this  first  30  to  45  days  on  board  ship, 
the  individual  will  be  assigned  to  an  Indoctrina¬ 
tion  Division,  with  a  division  officer  (master/ 
senior  chief)  oriented  to  the  needs  of  new  sail¬ 
ors.  This  allows  for  early  peer  group  identifica¬ 
tion  which  should  sustain  the  individual  until 
he  or  she  is  assigned  to  a  career  division  during 
the  latter  part  of  At-Sea  Orientation.  Assign¬ 
ment  to  the  mess  decks  is  an  acknowledged 
part  of  At-Sea  Orientation.  Most  ali  individuals 
would  participate,  but  only  once. 

6)  Both  vertical  and  horizontal  progression  paths 
are  provided  on  the  basis  of  measured  interests 
and  abilities.  Vertical  progression  involves  the 
main  career  path  and  stresses  increased  knowl 
edge  and  technical  skills.  This  path  includes 
shorebased  technical  training.  The  horizontal 
path  is  designed  for  those  individuals  who  can 
advance  to  greater  responsibility,  through  job 
enlargement  or  redesign,  while  maintaining  es 
sentially  the  same  knowledge/skill  level  and 
supported  by  job  performance  aids. 

7)  Shorebased  and  shipboard  training  are  treated 
as  one  training  system  with  the  advantages  of 
each  emphasized.  Instructional  techniques  such 
as  exportable  training,  self-study  techniques, 
non-resident  training,  "self-directed"  training 
concepts  and  associated  management  solutions 
will  be  employed  on  shipboard  using  existing 
systems,  personnel,  and  equipment.  This  pro¬ 
gram  will  be  closely  coordinated  with  the  more 
formalized  training  curricula  to  be  provided  at 
shorebased  schools.  The  model  includes  the 
conception,  development  and  test  of  a  ship¬ 
board  training  management  and  administration 
system  which  will  be  tested  as  a  part  of  this 
study. 

8)  The  attempt  was  made  to  fully  utilize  job  per 
formance  aiding  technology  including  such 
rather  new  innovations  as  hybrid  and  enriched 
aids.  It  is  through  aiding  that  we  get  the  indi 
vidual  on  the  job  early  and  contributing  direct 
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!\  aquipment  maintenance.  This  early 
"hands  on"  experience  is  .ntenaed  to  promote 
the  feeling  o’  involvement  ana  a  sense  of  ac¬ 
complishment. 

Test  and  Evaluation 

Pens  cai.  for  the  EPICS  to  be  tested  in  tne  fleet  be 
■l.nninQ  in  FY80  using  the  NATO  Seasparrow  Surface  Mis 
sile  System  as  the  test  vehicle.  An  evaluation  will  be  con 
ducted  to  appiaise  performance  ine'ements,  cost  benefits, 
life-cycle  cost  implications  and  personnel  system  impact 
considerations  where  fully  integrated  JPA  technology  is 
employed.  A  JPA  user's  guide  has  been  produced  which 
assures  the  best  application  of  job  performance  aid  design 
criteria  considering  such  factors  as  technician  aptitude  and 
experience,  equipment  complexity,  task  complexity  and 
training/support  criteria  (Booher,  1978).  Other  products 
which  will  result  from  the  study  are  job  performance  aids, 
training  packages,  career  and  training  path  outlines  and 
advancement  tests  for  the  NATO  Seasparrow  Surface  Mis¬ 
sile  System.  Also  to  be  provided  is  an  appraisal  of  the  life 
cycle  cost  benefits  and  cost  tradeoff  considerations  associ¬ 
ated  with  JPA  based,  integrated  personnel  systems.  In  ad¬ 
dition,  a  detailed  user's  guide  for  system  planners  and  de¬ 
velopers  in  the  optimal  utilization  of  performance  aiding 
technology  employed  with  a  personnel  systems  context 
will  be  forth  coming. 

Implementation 

Of  course,  if  a  personnel  system  concept  never  gets 
farther  than  a  graphic  diagram,  its  value  will  never  be  re¬ 
alized,  regardless  of  its  potential.  Hence,  an  important  part 
of  any  system  development  is  implementation  of  the  par¬ 
ticular  design  selected.  The  number  of  impact  areas  with 
EPICS  is  obvious.  They  include  most  all  the  elements  of 
the  current  personnel  system  from  recruiting  to  shipboard 
quota  control.  One  of  the  major  impact  areas  is  shipboard 
training.  Although  shipboard  personnel  may  be  willing  to 
share  the  training  responsibility  with  the  shorebased  train¬ 
ing  community,  considerable  aid  and  support  is  going  to  be 
required. 

Actually,  implementation  should  be  considered  an¬ 
other  system  design  function  and  followed  through  system 
development.  With  EPICS,  the  implementation  program  in¬ 
volves  carefully  planned  briefings,  informal  interaction 
with  experienced  shipboard  personnel,  the  development  of 
change  intervention  strategies,  and  the  identification,  train¬ 
ing  and  support  of  change  advocates  on  board  our  test 
snips.  Implementation  involves  as  much  attention  and 
technical  effort  as  any  other  task  in  the  system  design 
process. 

Payoffs 

The  implementation  of  integrated  personnel  systems 
such  as  EPICS  offers  an  exceedingly  promising  avenue  for 
aedressing  the  goals  and  objectives  stated  earlier.  It  is  be¬ 
lieved  that  EPICS  can  provide  considerable  leverage  in  the 
maintenance  training  area  by  (a)  reducing  front-end-loaded 
training  and  associated  costs,  (b)  increasing  the  relevance 
of  both  shorebased  and  shipboard  training  through  coordi¬ 
nation,  (c)  improving  the  quality  of  the  student,  (d)  reduc¬ 


ing  shipboard  maintenance  costs,  (e)  affording  better  util i 
zation  of  available  personnel  particularly  those  considered 
to  be  "lesser  aptitude,"  (f)  reducing  attrition,  ano  (g)  en 
hancing  overall  job  satisfaction  with  the  enlisted  com 
munity. 

RECOMMENDATIONS 

The  importance  of  lowering  the  barriers  to  the  use  of 
a  systems  viewpoint  when  dealing  with  the  elements  of  a 
personnel  system  cannot  be  overstressed.  Such  an  endeavor 
will  require  the  cooperation  of  all  communities  involved  in 
personnel  systems  research  and  development. 

First,  practitioners  of  the  psychotechnologies  which 
are  represented  in  personnel  systems  design  and  develop¬ 
ment  must  become  more  attuned  to  the  systems  approach 
and  insistent  that  the  result  of  a  particular  approach  be 
viewed  and  appraised  within  the  context  of  the  total  sys¬ 
tem.  Usually,  there  are  but  a  few  primary  system  elements 
which  need  to  be  addressed  to  determine  that  the  ap 
proach  is  indeed  optimum  and  that  no  negative  impacts  are 
possible. 

Workshops  and  element-oriented  technical  meetings, 
such  as  this  one  on  maintenance  training,  should  include 
representation  of  the  other  personnel  system  "elemen- 
talities"  with  which  such  training  interacts.  This  might 
serve  to  develop  an  awareness  of  the  potential  dangers  of 
pursuing  a  single  element  approach  to  system  redesign. 
Also,  it  would  help  educate  representatives  of  other  ele¬ 
ments. 

Lastly,  government  and  industry  must  somenow  be 
come  more  attuned  to  the  necessity  of  an  integrated  sys 
terns  approach  to  matters  related  to  the  design  and  devel 
opment  of  personnel  systems.  One  approach  here  would  be 
to  include  a  personnel  systems  module  within  the  Logistic 
Support  Analysis  requirement  (MIL-STD-1388)  during 
hardware  system  design  and  development.  Perhaps  through 
coordination  committees  or  steering  groups,  it  would  be 
possible  to  achieve  some  degree  of  interchange  among 
those  organizational  components  concerned  with  peopie- 
related  research  and  development. 

The  Integrated  Personnel  Systems  Approach  (IPSA) 
presented  here  is  but  one  approach  to  the  problem  of 
achieving  and  maintaining  a  personnel  systems  viewpoint. 
The  question  is  not  so  much  what  model  or  approach  to 
employ  but  how  effective  or  adaptable  it  might  be  in  a 
given  problem  situation  in  reinforcing  the  viewpoint  that 
one  must  look  at  the  total  personnel  system  even  when  in 
vestigating  but  a  part  of  it.  With  that  orientation,  we  can 
begin  to  protect  against  forcing  design  actions  which  re 
suit  in  less  than  optimum  use  of  our  steadily  decreasing 
resources.  As  indicated  at  the  outset,  our  traditional  ap 
proaches  to  personnel  P&D  must  be  critically  reviewed 
and  new  initiatives  explored,  Perhaps  by  that  avenue  we 
can  draw  together  a  technology  which  will  allow  us  to 
deal  effectively  with  the  increasingly  difficult  personnel 
system  problems  of  the  future. 
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Silver  Spring,  Maryland 


ABSTRACT 

This  paper  is  a  technology  assessment  concerning  future  tri-service  and  Industrial 
applications  of  automated  aiding  systems.  The  technology  base  is  essentially  available 
at  this  time,  and  with  sufficient  support  by  Department  of  Defense  agencies  can 
be  substantially  brought  to  bear  upon  problems  of  personnel  productivity  in  military 
technical  maintenance  by  1985.  Current  military  interest  in  reducing  formal  training 
and  increasing  on-the-job  training  through  improved  aiding  techniques  may  receive 
more  effective  implementation  through  automated  aiding  support  systems.  The  facil¬ 
ities,  technical  specialties  and  key  new  developments  needed  to  permit  widespread 
military  and  industrial  applications  of  automated  aiding  technology  are  discussed.  It 
is  projected  that  alt-digital-data  approaches  to  military  technical  information  will 
eventually  be  incorporated  into  comprehensive  logistics  information  management  sys¬ 
tems,  with  tri-service  cooperation  and  information  sharing. 


INTRODUCTION 

Product  maintainability  is  a  matter  of  substantial  con¬ 
temporary  concern  to  manufacturers  of  complex  military 
and  industrial  systems.  With  continuing  technological  ad¬ 
vances  in  hardware  systems  designs,  the  point  is  increasing¬ 
ly  being  surpassed  beyond  which  system  users  cannot  keep 
equipment  operational  as  much  of  the  time  as  required  by 
circumstances.  Frequent  and  costly  equipment  vendor 
supplied  field  maintenance  is  often  unavoidable. 

Several  factors  have  particularly  contributed  to  these 
equipment  availability  problems.  One  factor  has  been  the 
recent  disappearance  of  well-trained  and  experienced  tech¬ 
nicians  from  American  industry  and  the  military  services. 
Many  of  these  individuals  entered  the  job  market  at  the 
conclusion  of  World  War  II,  and  have  recently  retired. 
Their  younger  replacements  tend  to  be  more  mobile  and 
apparently  attach  less  importance  to  the  place  of  work  in 
tneir  life  styles.  Training  costs  have  increased  because  of 
the  increased  worker  mobility,  agency,  company  and 
union  policies,  and  other  factors.  Another  contributing 
factor  is  the  increasing  hardware  complexity  associated 
with  engineering  progress.  Large  amounts  of  time  are  con¬ 
sumed  in  maintaining  complex  hardware  systems,  search¬ 
ing  through  technical  manuals  that  are  inadequate  with 
respect  to  usability.  As  indicated  by  Figure  1,  a  modern 
aircraft  has  many  repairable  parts  than  was  the  case  in 
earlier  aircraft,  and  requires  substantially  more  technical 
data  for  routine  maintenance  information  support.  These 
data  specifically  suggest  the  presence  of  a  long-term  trend 


of  increasing  system  complexity,  and  continuously  bur 
geoning  technical  data,  with  no  evidence  of  relief. 
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FIGURE  1.  Typical  Technical  Manual  Growth 


What  is  now  being  experienced  in  the  Department  of 
Defense  and  in  American  industry  in  the  system  maintain 
ability  area  appears  to  represent  a  general  condition  of  re 
duced  personnel  productivity,  reduced  systems  availability, 
and  increased  costs  for  maintenance,  all  of  which  contrib 
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ute  to  reduced  operational  capacity  and  reduced  combat 
readiness 

8uilt  in  test  equipment  and  automatic  test  equip¬ 
ment  solutions  to  equipment  maintainability  continue  to 
enjoy  substantial  popularity,  but  cannot  suffice  as  total 
solutions  to  equipment  maintainability  problems.  Recent 
innovations  m  ;ob  performance  aiding  technology,  such  as 
the  fuiiy  proceduralized  job  performance  aids  (FPJPA)  and 
associated  task  analysis  have  been  shown  to  offer  more 
workable  solutions  than  traditional  technical  manuals 
(Foiey,  1978).  The  newer  types  of  job  aiding  techniques 
have  not  as  yet,  however,  received  the  amount  of  deploy¬ 
ment  that  would  appear  to  be  deserved,  and  experience 
with  these  newer  aiding  techniques  still  remains  relatively 
limited. 

Given  the  clear  and  obvious  contributions  of  inade¬ 
quate  technical  data  to  current  problems  of  system  avail¬ 
ability,  it  is  clear  that  higher  priorities  should  be  estab 
lished  for  technical  data  improvement  programs.  Figure  2 
illustrates  these  relationships.  More  data  are  obviously 
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FIGURE  2.  Impact  of  Defective  Technical  Information 


needed  in  the  area  of  improving  job  aiding  effectiveness  of 
the  newer  techniques  such  as  the  fully  proceduralized  job 
performance  aids  (FPJPA)  and  the  functionally  oriented 
maintenance  manuals  (FOMM),  as  well  as  for  new  tech¬ 
nique  development.  However,  it  is  being  increasingly  un- 
destood  that  hard-copy  technical  data  are  approaching  the 
limits  of  continuing  refinement  and  that  is  will  soon  be 
necessary  to  place  reliance  upon  other  communicative 
media.  Available  expertise  in  the  area  of  improving  hard¬ 
copy  |ob  performance  aiding  techniques  is  still  slim.  Exper¬ 
tise  in  the  area  of  interactive  automated  job  performance 
aiding  system  development  research  is  even  slimmer. 

There  is  an  associated  need  for  building  up  in-house 
laboratory  facilities  and  in  development  of  sustained  con¬ 
tractor  research  programs  in  these  several  areas  of  research 
and  development  emphasis,  so  that  more  programmatic  re¬ 
search  efforts  can  be  undertaken  and  sustained  for  the  nec¬ 
essary  time  periods. 


AUTOMATED  AIDING  SYSTEM  APPROACHES 

Automated  aiding  systems  represent  a  new  approach 
to  job  performance  aiding  technology,  and  the  Army, 
Navy,  and  Air  Force  are  all  examining  the  potential  pay 
offs  of  computer-based  systems  for  replacing  hard-copy 
performance  aids.  A  number  of  alternative  approaches  are 
being  developed  for  automated  technical  data  presentation 
at  this  time.  Among  the  different  approaches  are  auto¬ 
mated  troubleshooting  logic  aiding  systems.  CRT-terminal 
systems  for  transliteration  of  hard-copy  technical  content, 
and  general  purpose  computer-mediated  systems  that  can 
present  technical  information  (Tl)  using  various  types  of 
aiding  formats.  Both  central  mainframe  and  minicomputer 
mediated  varieties  of  this  latter  approach  are  under  devel 
opment  at  this  time.  Computer-controlled  video  disc  sys¬ 
tems  are  a  matter  of  some  current  emphasis,  as  an  inter¬ 
mediate  step  in  the  direction  of  data  automation  technol 
ogy  development. 

At  this  early  time  in  evolutionary  development,  auto 
mated  job  performance  aiding  systems  designs  are  being 
approached  in  different  ways.  There  has  been  some  em 
phasis  placed  upon  special-purpose  designs  for  single  types 
of  maintenance,  such  as  troubleshooting.  There  has  also 
been  some  emphasis  in  the  possibility  of  eliminating  hard 
copy  technical  data  altogether,  and  its  replacement  with 
all-digital-data  systems  that  will  eventually  be  used  for  the 
entire  process  of  technical  data  generation,  distribution, 
use,  and  updating. 

Our  own  work  has  involved  both  system  development 
research  on  deriving  performance  specifications  for  a  mini 
computer-based  technical  data  delivery  device  and  an  ad 
vanced  large  system  design  effort  for  an  entire  Navy  wide 
technical  information  centralization  and  management  sys 
tem  that  includes  automated  technical  information  dehv 
ery.  Through  the  former  work,  we  have  been  able  to  estab 
lish  design  requirements  for  a  state-of-the-art  system  for 
technical  data  delivery  by  the  Air  Force  Human  Resources 
Laboratory  (Frazier,  Roth,  and  O'Heeron,  1978;  Frazier, 
Roth,  and  Huang,  1978).  Through  the  latter  work,  we  have 
outlined  a  system  scenario  for  a  Navy-wide  all-digital-data 
Tl  system  for  the  Navy  Technical  Information  Presenta 
tion  Program  (Roth,  Frazier,  and  Howell,  1979).  The  is¬ 
sues  and  implications  discussed  below  have  been  drawn 
from  this  work,  particularly  from  the  Navy  work. 

ISSUES  IN  AUTOMATED  AIDING  SYSTEM  DESIGN 

With  respect  to  the  fact  that  the  Department  of  De¬ 
fense  has  many  claimants  for  a  finite  budget,  it  is  quite 
possible  that  pressures  will  grow  in  support  of  restricting 
research  and  development  on  automated  aiding  systems  to 
a  few  large-scale  system  design  projects  that  could  promise 
early  payoffs  in  short-term  time  frame.  This  kind  of  ap 
proach  has  backfired  in  the  past,  in  large-scale  logistics  in¬ 
formation  management  programs  with  ambitious  plans  but 
hasty  implementation  efforts.  This  particular  technology  is 
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..mi.:  ,j  .1  ,0  .vc  .ci'scribc  u  a  more  cautious 
Fi&p  ..evuupi  -c.- 1  si  ..Ic.j,  tnat  inciuoes  concurrent  tab 
. i r  j ; .  r  v  ,  r»L-  c  stony  comijonents,  preliminary  to  lai-gt-- 

sc.iic  . -.u'emcnlaiion  eHurts.  For  example,  the  Navy  Tech- 
,,.,.1,  ,i.:u.-:t>at.o .1  t'.-esectatiuu  P-ogram  is  adopting  sucn 
r  a  .pioacii  os  we  support,  in  preference  over  the  alternu- 

o'  ; i.cc irii,  together  hardware  without  clearly  devei 
,  ;ieu  plaining  to'  the  eventual  total  plan  for  technical 
i m la  ai.tomcition  For  many  industrial  applications,  how- 
ver,  inexpensive  technical  information  preparation  sys- 
lems  can  oe  developed  in  conjunction  with  automated 
tecnnicj.  information  delivery  devices,  so  that  implemenra- 
i.on  of  data  automation  can  be  accomphsned  in  a  much 
snorter  time  name. 

Tne  tune  ,s  near  at  which  project  managers  of  major 
weapon  systems  wiii  oe  exposed  to  automated  aiding  sys¬ 
tem  cuncepts  and  techniques.  This  possioility  suggests 
tnat  nne  ot  the  first  substantive  military  applications  of 
automated  technical  information  systems  will  involve 
establishing  an  automatea  system  in  support  of  a  specific 
projc-i  t  office.  Wnat  is  expected  is  an  actual  Deployment 
of  system  specific  automated  Tl  systems  at  the  project 
irvei,  anc  an  eventual  standardization  process  for  such  sys- 
terns  as  department-wide  implementation  becomes  a  viable 
possibility.  In  the  industrial  applications  area,  applications 
wul  be  more  varied,  with  more  diverse  system  configura¬ 
tions  and  application  programming. 

Since  the  logistics  commands  represent  the  ultimate 
Customers  for  such  systems,  issues  can  be  expected  to 
ar  se  concerning  the  definition  of  appropriate  roles  for  the 
m  service  computer  science  organizations,  the  human  fac¬ 
tors  and  training  research  laboratories,  and  special  project 
offices  for  technical  information  systems  development  and 
management.  While  no  recommendations  concerning 
appropriate  roles  are  made  here,  it  seems  evident  that  the 
logistics  agencies  couid  use  greater  levels  of  laboratory  sup¬ 
port  than  has  thus  far  been  the  case;  that  continuing  sys¬ 
tem  enhancements  could  be  better  guaranteed  by  active 
human  resources  and  computer  science  laboratory  R&O 
urograms  of  a  more  programmatic  type;  and  that  some 
level  of  cemralized  management  of  these  various  efforts 
would  be  important  for  maintaining  adherence  to  goals. 

DESIGN  PHILOSOPHY 

The  underlying  purpose  of  technical  information  is  to 
support  trainee  and  technician  information  needs.  Conse¬ 
quently,  the  degree  to  which  a  particular  set  of  technical 
data  can  do  so  for  representative  members  of  these  popu¬ 
lations  should  be  the  primary  criterion  of  technical  infor¬ 
mation  effectiveness.  From  this  point  of  view,  any  aiding 
system,  regardless  of  medium  choice  should  be  evaluated 
relative  to  those  features  that  contribute  to  technical  in¬ 
formation  usability.  The  further  extension  of  this  point  is 
nat  usability  enhancement  criteria  should  drive  the  over¬ 
all  system  design. 

After  Chenzoff's  usability  criteria  (1973),  the  tech 
meal  information  should  be  correct.  The  full  range  of  users 
snould  find  Tl  content  to  be  unOerstandable.  The  Tl 


should  be  capable  of  being  rapidly  found  when  needed. 
The  Tl  should  meet  the  specific  user's  needs  Tl  snould  be 
current.  Tl  should  be  complete.  Finally,  the  Tl  should  not 
be  so  bulky  that  it  is  difficult  to  use  or  to  transport  to  the 
work  sues  used. 

These  usability  criteria  are  easy  to  identify,  but  not 
so  easy  to  satisfy  in  developing  system  design  require¬ 
ments.  For  example,  there  is  no  homogeneous  population 
of  maintenance  technicians.  Instead,  a  wide  range  of  skill 
levels  and  areas  of  specific  knowledge  can  be  found  in  the 
technician  populations.  Thus,  information  that  is  complete 
for  one  individual  can  be  found  to  be  quite  incomplete  for 
another.  Similarly,  information  that  is  quite  compreher, 
slble  to  one  individual  can  be  incomprehensible  to  another. 
Maintenance  technicians  differ  in  information  support  re 
quirements  to  do  a  job  and  in  the  type  of  job  aids  that  are 
useful  to  them. 

The  implications  of  usability  analysis  are  that  techni¬ 
cians  have  different  information  support  needs  and  have  to 
be  communicated  with  in  different  ways.  This  premise 
implies  a  system  design  requirement  for  Tl  presentation 
systems  that  can  communicate  in  these  different  ways  and 
present  alternative  types  of  aiding  data,  so  that  technicians 
can  select  the  information  that  is  most  meaningful  and  in¬ 
formative  for  the  individual  case.  With  such  a  system,  there 
is  also  an  obvious  requirement  for  technician-system  com 
munication  capabilities  so  that  alternative  forms  of  dis¬ 
course,  aiding  techniques,  and  formats  can  be  selected  as 
needed. 

An  optimal  general-purpose  automated  job  perform 
ance  aiding  systems  would,  thus,  have  to  be  capable  of 
multiple  levels  of  discourse,  so  as  to  communicate  to  tech¬ 
nicians  of  different  skill  and  experience  levels.  It  would 
have  to  be  capable  of  presenting  various  types  of  job  per 
formance  aids.  It  would  have  to  be  an  interactive  system, 
so  as  to  allow  technicians  to  tailor  the  information  re¬ 
ceived  to  expressed  needs.  These  requirements  would 
appear  to  necessitate  reasonably  good  qual'ty  computer 
graphics,  for  presenting  such  3ids  as  maintenance  depen 
dency  relationships,  block  schematic  diagrams,  wiring  dia 
grams,  locator  diagrams,  and  illustrated  parts  breakdowns. 

All  of  these  requirements  have  to  do  with  human  fac¬ 
tors  issues  and  criteria  for  software  and  hardware  develop 
ment.  In  our  organization,  therefore,  system  development 
efforts  in  this  area  are  directed  by  human  factors  psycholo¬ 
gists  and  system  simulation  facilities  have  been  used  to 
confirm  the  degree  to  which  application  software  supports 
the  human  factors  requirement  determinations. 

The  hardware  and  software  techniques  needed  to  sup¬ 
port  these  kinds  of  user-oriented  requirements  are  esse.n 
tially  available.  The  major  limitation  at  present  in  the  hard 
ware  area  is  the  unavailability  of  a  lightweight  and  com¬ 
pact  flat  panel  display,  capable  of  presenting  complex  line 
drawings  with  the  desired  resolution.  The  development  of 
high-resolution  plasma  panel  displays  represents  a  viable 
option,  although  it  would  appear  that  plasma  technology 
will  never  approach  the  resolution  associated  with  CRT 
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Terminals.  The  use  of  CRT  terminal  displays  would  appear 
to  be  better  justified  for  most  applications,  both  with 
respect  to  cost  and  resolution  variables. 

The  development  of  solid  state  memory,  such  as 
bubble  memory  or  charge-coupled  devices  operating  as 
mass  storage  devices  is  not  yet  sufficiently  advanced  to  be 
incorporated  in  automated  aiding  systems.  It  would  appear 
that  for  some  years  yet,  it  will  be  necessary  to  utilize 
digital  disk  technology,  until  solid-state  and  video-based 
mass  memory  systems  become  viable  alternatives. 

TECHNICAL  DATA  PREPARATION 

No  technical  information  delivery  system  can  be 
considered  usable  if  the  data  are  incorrect  or  unavailable. 
These  usability  criteria  can  be  satisfied  only  through 
systematic  procedures  for  technical  data  preparation, 
technical  input  by  well-informed  engineers,  and  hands-on 
verification  of  the  data.  It  now  appears  that  the  technical 
data  preparation  procedures  and  practices  represent  the 
main  challenges  in  automated  technical  information  sys¬ 
tem  development. 

figure  3  outlines  processes  and  flows  associated  with 
a  hypothetical  technical  information  preparation  system 
approch,  such  as  the  Navy  might  establish  if  it  were  de¬ 
cided  to  adopt  an  all-digital  data  technical  information 
approach,  as  opposed  to  other  alternatives  now  under  con¬ 
sideration.  The  necessary  Tl  preparation  system  would, 


first  of  all,  require  the  establishment  of  new  military 
standards  and  specifications  that  would  be  more  appro 
priate  to  generation  of  automated  Tl.  These  standards 
and  specifications  would  then  have  to  be  translated  into 
specification  compliance  software  that  could  empirically 
test  Tl  contractors'  data  against  compliance  standards. 

A  digital  data  base  would  be  prepared  for  the  engi¬ 
neering  data  on  the  hardware  system.  It  would  then  be 
subjected  to  analyses  concerning  establishment  of  initial 
requirements  for  user  Tl  needs,  given  the  prevailing  main 
tenance  guidelines  and  philosophy.  The  actual  production 
of  Tl  could  then  be  undertaken  using  a  specialized  Tl  prep¬ 
aration  system  with  associated  application  software.  Con 
tractor  validation  of  Tl  content  and  correction  of  deficien¬ 
cies  could  then  be  accomplished,  again  using  the  specifica 
tion  compliance  test  software,  and  through  using  represen¬ 
tative  technicians  for  test  purposes. 

The  buying  activity  could  then  schedule  Tl  usability 
analyses,  employing  larger  numbers  of  technician  test  sub¬ 
jects,  as  a  condition  for  acceptance  of  theTI  product.  The 
prepared  Tl  in  final  acceptable  form  could  then  be  ar 
chived  for  subsequent  distribution. 

Such  a  system  outline  implies  Department  of  Defense 
provision  of  either  applications  software  or  even  complete 
Tl  preparation  systems  to  contractors  as  government  fur¬ 
nished  equipment. 


FIGURE  3.  Processes  and  Flows  in  Preparation  of  Tl  in  An  Automated  System 
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aytnc  ts  undertake  the  task  of  developing  modern  data 
automation  fac.iities.  it  will  be  interesting  to  determine 
wnener  tney  fund  the  human  factors  and  software  devel¬ 
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sir.. ply  accept  me  prevailing  techniques  used  commercially 
and  ignore  the  human  factors  work  that  should  be  added 
to  the  front  end  analysis  process  to  maximize  Tl  usability. 

With  aspect  to  specific  development  requirements 
for  a  state-of-the  art  system  for  automated  Tl  preparation, 
the  next  figure  represents  a  point  of  view. 


The  computer  thesaurus  requirement  pertains  to 
establishment  of  a  technique  for  converting  technical 
writer  or  engineering  language  into  discourse  more  suit 
able  for  use  in  system  communications  with  technicians 

The  graphics  and  textual  information  can  then  be 
integrated  under  the  control  of  format  control  software, 
using  the  engineering  data  to  be  communicated  via  engi 
neering  data  base  software.  The  Tl  data  base  software  can 
thus  oe  created,  and  checked  for  compliance  with  govern¬ 
ing  specifications.  The  draft  Tl  package  can  then  be  stored 
for  further  evaluations. 

Development  of  such  a  system  would  be  no  trivial 
undertaking,  but  one  which  could  certainly  be  undertaken 
at  this  time.  The  product  would  hopefully  be  suitable  for 
tri -service  as  well  as  for  contractor  purposes. 
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FIGURE  4.  Key  Development  Area  Requirements  for  Tl  Preparation  System 
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;n:s  ;  .ne.  Tnere  ;s  no  CGmmerc.aiiY  available  graphics 
scunner  that  ton  automatically  convert  graphics  inform* 
tion  in  the  form  one  drawings  into  digital  vecto'  infor- 
•  rat»or  as  tar  as  we  know.  The  Army  is  funding  a  develop 
hem  effort  on  this  problem  at  present,  although  the  pro 
jtet  is  still  »n  an  early  ohase  of  development. 

The  development  of  a  graohics  component  library 
mo  associated  software  would  allow  recourse  to  contem 
pomry  interactive  graphic  production  techniques,  which 
ar  *  iimted  a:  this  time  primar:.y  to  university  computer 
science  laboratories.  With  such  a  library  and  suitable  Tl 
preparation  system  it  should  be  possible  to  construct 
complex  ^.lustrations  rapidly  and  w.th  minimal  cost, 
Through  interactive  retrieval,  scaling,  and  positioning  of 
i’an  jarcl  graphic  components  and  graphic  assemblies,  and 
to  store  the  finished  graphics  in  computer  storage  to  await 
integration  with  textual  data. 


IMPLICATIONS 

a  will  obvious"/  take  some  years  and  first-rate  human 
'esoorces  to  develop  fully  operational  all  digital  data  Ti 
systems  tor  seance  wide  and  contractor  generation,  resting, 
distribution,  use  and  updating.  Efforts  of  this  kino  must  be 
approached  carefully  and  sustained  for  some  years,  both 
w.th  respect  to  special  oroject  offices  and  cooperating  con 
tractors.  The  technology  is  new  and  evoivmg  rapidly,  with 
a  scarcity  of  available  expertise.  However,  it  seems  equanv 
possible  to  rea.ize  near-term  payoffs  of  technical  data 
automation  that  can  impact  significantly  upon  the  basic 
problems  ot  operational  capabilities  and  system  availabu 
ity  for  specific  weaoon  and  industrial  project  offices. 

What  easily  could  result  would  be  a  concurrent  dev 
opment  and  implementation  process,  in  which  logistics 
agencies  incrementally  build  capabilities  for  technical  oat  a 
automation,  and  project  offices  introduce  automated  Ti 
systems  for  their  own  syjtem  projects.  At  some  point  in 
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the  future,  these  concurrent  developments  coulo  merge 
into  service  wide  and  industry  wide  Tl  data  automation 
systems  that  service  Tl  user  needs  on  a  general  basis. 

Early  evidence  of  a  new  trend  is  also  emerging  from 
the  administrative  information  processing  area.  End  user 
oriented  administrative  system  designs  are  now  beginning 
to  be  taken  seriously  and  several  federal  civilian  agencies 
are  now  designing  nation-wide  administrative  job  perform¬ 
ance  aiding  systems.  These  efforts  apparently  have  been 
undertaken  independent  of  any  communication  with  the 
Department  of  Defense  technical  data  community,  sug¬ 
gesting  a  Zeitgeist  that  is  increasingly  supportive  of  com 
puter  aiding  systems  for  humans.  Some  level  of  cross- 
fertilization  would  appear  to  be  likely  between  these 
hardware-oriented  and  administration-oriented  agencies. 

Another  trend  that  may  impact  upon  the  evolution 
of  automated  job  performance  aiding  systems  is  the  home 
computer  market.  This  market  has  already  become  suffi¬ 
ciently  large  that  major  computer  manufacturers  are 
entering  into  it.  The  current  orientation  remains  that  of 
marketing  computer  games,  but  with  some  small  and  in¬ 
creasing  emphasis  upon  computer-assisted  instruction 
applications.  What  could  be  predicted  after  automated 
job  performance  aiding  systems  are  popularized  is  the 
development  of  a  brisk  market  for  the  sale  and  distrib¬ 
ution  of  aiding  and  training  packages  for  special-purpose 
home  computer  configurations. 

It  is  difficult  to  protect  the  rate  at  which  these  dif¬ 
ferent  applications  will  develop.  It  would  seem  quite 
likely,  however,  that  the  industrial,  administrative,  and 
home  applications  will  all  be  well  developed  and  will  be 
enjoying  a  viable  market  within  five  years.  The  military 
applications  could  be  enjoying  some  significant  level  of 
implementation  not  long  thereafter.  However,  decisions 
to  adopt  the  so-called  intermediate  solutions  such  as  com¬ 
puterized  microform  and  video  disc  systems  could  delay 
this  development  by  at  least  another  five  years.  Thus, 
large-scale  military  implementation  of  all  digital  data  tech¬ 
nical  information  systems  could  be  postponed  until  well 
into  the  1990's,  depending  upon  the  decisions  made  at 
policy  end  planning  levels  and  at  logistics  agency  head¬ 
quarters  over  the  next  several  years. 
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ABSTRACT 


One  of  the  oldest  and  most  frequently  used  methods  of  training  personnel  is  on 
the-job  training.  The  Army  has  had  to  rely  on  this  method  to  transfer  specific  skills 
and  knowledges  to  the  soldiers  who  have  received  only  broad  principles  and  skills 
training  in  a  formal  classroom  setting.  There  are  inherent  weaknesses  to  the  on-the-job 
training  method,  however,  which  detract  from  its  overall  usefulness  in  improving  indi¬ 
vidual  soldier  proficiency.  Lack  of  adequate  training  materials,  lack  of  equipment, 
and  little  or  no  diagnostic  measures  are  examples  of  such  deficiencies.  The  advent  of 
fully  proceduralized  technical  manuals  has  presented  a  unique  opportunity  to  remedy 
these  weaknesses.  The  Army  is  seeking  to  obtain  the  maximum  benefit  of  the  proce¬ 
duralized  manuals  in  its  Skill  Performance  Aids  program.  An  on-the-job  training 
package  is  developed  for  each  equipment  system  that  uses  the  manual  as  the  prime 
instructional  material  and  attends  not  only  to  the  needs  of  the  inexperienced  soldier 
but  also  to  his  supervisor  as  well. 


INTRODUCTION 

The  Department  of  Defense  continues  to  seek  to  pro¬ 
vide  the  best  possible  defense  system  that  can  contain  and 
repel  any  military  threat.  As  in  the  past  it  turns  toward 
hardware  technology  advances  as  the  chief  method  of  in¬ 
suring  our  superiority  Again,  as  in  the  past,  it  must  use 
other  means  as  well  if  it  is  to  offset  the  numerical  advan¬ 
tages  and  increased  technological  capabilities  of  foreign 
powers.  One  such  means  is  training  which  has  frequently 
spelled  the  difference  between  success  and  disaster.  The 
improvement  of  training,  while  always  a  goal,  has  been 
gaining  in  national  interest  as  well  as  controversy.  The  ob¬ 
vious  interest  has  come  because  everyone  recognizes  the 
need  to  be  in  a  continual  state  of  readiness  to  meet  the 
possibility  of  a  rapid  attack.  The  first  battle  has  taken  on 
extreme  importance.  The  concern  of  the  US  Army  for 
maintaining  readiness  is  shown  by  an  increase  in  testing  of 
both  units  as  well  as  individuals.  Moreover,  this  testing  pro¬ 
gram  has  been  intently  aimed  at  measuring  proficiency  on 
the  actual  tasks  that  our  Army  will  have  to  perform  in  the 
event  of  war.  The  results,  as  you  may  well  expect,  are  not 
always  gratifying  and  point  out  the  need  for  better  training 
to  improve  performance.  At  the  same  time  materiel  readi¬ 
ness  reports  continue  to  point  out  equipment  problems, 
some  of  which  are  directly  attributable  to  problems  in 
human  performance. 

The  controversy  arises  over  the  various  strategies  that 
we  should  employ  to  overcome  these  deficiencies.  At  the 
center  of  the  controversy,  as  you  would  expect,  is  the 


dollar.  No  longer  can  we  be  concerned  with  only  training 
effectiveness  but  we  must  be  concerned  with  efficiency  as 
well.  As  a  result  we  see  elaborate  models  being  constructed 
that  seek  to  optimize  our  training  investments.  New  meth 
ods  of  instruction  are  being  explored  that  include  the  use 
of  automation  for  both  presenting  and  controlling  instruc¬ 
tion,  the  use  of  self  paced  courses  that  include  audio  and 
audiovisual  media  and  a  general  trend  toward  insuring  that 
all  such  instruction  is  criterion  referenced.  The  controversy 
arises  in  not  only  selecting  the  approach  to  be  used  but 
also  in  deciding  how  much  training  should  be  given. 

The  answers  are  far  from  being  clear,  at  least  in  part, 
because  we  have  yet  to  obtain  a  consensus  on  what  the 
problem  is.  Therefore  before  I  describe  one  of  the  Army's 
present  solutions  I  would  like  to  describe  first  what  prob¬ 
lem  that  solution  is  intended  to  alleviate. 

The  Army  is  increasing  in  its  mechanization  averaging 
.71  systems  per  man,  not  including  individual  small  arms 
The  systems  have  also  become  much  more  sophisticated  in 
terms  of  capability  and  accordingly  in  terms  of  compo¬ 
nents  as  well.  No  longer  do  we  have  the  luxury  of  special 
izing  individuals  on  any  one  system  at  the  training  schools 
A  single  specialty  such  as  a  63C  track  vehicie  repairman 
can  potentially  encounter  any  one  of  more  than  a  hundred 
vehicles.  Obviously,  trainers  at  the  school  can  only  teach 
general  principles  and  techniques  and  then  hope  that  as  the 
individual  soldier  receives  on-the-job  training  and  gains  in 
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experience  that  the  will  be  able  to  cope  with  any  problems 
that  he  encounters.  The  problem  has  been  that  this  ap¬ 
proach  when  used  in  the  past  has  left  something  to  be  de¬ 
sired  as  indicated  by  our  tests  and  materiel  readiness  re 
ports.  Adding  more  formal  training  has  not  been  an  ade 
quate  solution  because  of  the  evidence  of  learning  decay 
and  the  unpredictability  of  future  assignments.  The  cost  of 
such  training,  in  light  of  the  rising  personnel  costs  for  sal¬ 
aries,  benefits,  etc.,  and  the  normal  high  attrition  rate 
makes  additional  formal  training  an  option  that  we  cannot 
afford.  Yet  the  Army  does  recognize  that  additional  train¬ 
ing  is  required.  The  Army's  Skill  Performance  Aids  (SPA) 
Program  is  one  attempt  to  increase  the  level  of  individual 
proficiency  without  drastically  incurring  huge  training 
costs.  This  paper  reports  on  the  development  of  this  pro¬ 
gram. 

THE  SPA  PROGRAM 

The  Skill  Performance  Aids  Program  consists  of  im¬ 
proved  technical  manuals  and  extension  training  materials 
that  are  developed  on  the  basis  of  a  common  front-end 
analysis. 

Improved  Technical  Manuals 

Beginning  with  the  PIMO  Project  (Foley,  1978)  in  the 
early  Sixties  the  potential  capability  of  fully  procedur- 
alized  technical  manuals  to  improve  human  performance 
gradually  has  been  recognized.  In  the  Army  these  types  of 
manuals  are  becoming  institutionalized  and  new  systems 
and  selected  fielded  systems  are  being  supported  by  this 
approach.  The  process  of  institutionalization  has  not  been 
easy  and  indeed  SPA  still  invites  skepticism  because  of  the 
additior  a!  cost  and  time  associated  with  its  development. 
Despite  the  consistent  positive  results  obtained  in  experi¬ 
mental  settings  critics  argue  that  similar  results  will  not  be 
achieved  operationally  because  the  manuals  will  not  be 
used  or  will  not  be  used  properly.  Moreover  they  fear  that 
the  availability  of  such  manuals  will  be  used  as  an  excuse 
to  wipe  out  all  formal  training  and  that  complete  depen¬ 
dency  will  be  placed  on  the  manuals. 

The  Army  Approach.  The  Army  has  quickly  recog¬ 
nized  that  some  degree  of  initial  formal  school  training  will 
always  and  should  always  be  required  even  with  the  pres¬ 
ence  of  fully  proceduralized  manuals.  The  emphasis  of  this 
initial  training  is  on  providing  generic  skills  such  that  the 
individual  can  then  learn  the  specific  tasks  associated  with 
his  job.  The  manuals,  therefore,  while  proceduralized  do 
not  contain  details  as  to  how  to  use  a  particular  hand  tool 
or  piece  of  test  equipment.  They  do  provide  details  spe¬ 
cific  to  the  particular  piece  of  equipment.  Thus  the  63C 
repairman  will  have  been  taught  how  to  repair  a  section  of 
track  on  a  tank  but  not  on  all  tanks.  The  manuals  will  de¬ 
scribe  the  location  of  items  and  the  order  of  steps  to  be 
followed  for  a  particular  tank.  The  design  of  the  manuals  is 
well  documented  and  need  not  be  repeated  here  (see  for 
example  the  JPA  Technology  Workshop  Proceedings. 
Human  Factors  Society,  1977).  The  Army  is  convinced 
that  these  manuals  are  required.  It  differs  from  the  other 
services  in  that  in  addition  to  performance  enhancement  it 


finds  in  these  manuals  a  unique  opportunity  to  create  a 
uniform  effective  on  the  job  training  program. 

Implications  of  Improved  Manuals  for  Training.  Con 
ventional  manuals  which  have  been  equipment  descriptive 
have  not  provided  the  details  needed  to  support  the  soldier 
in  training.  The  TRADOC  schools  have  had  to  generate  a 
considerable  amount  of  equipment  specific  training  mate 
rials  to  teach  these  details  to  the  soldier.  S.nce  the  major 
ity  of  these  items  do  not  accompany  a  soldier  to  his  unit, 
the  soldier  finds  himself  in  a  new  job  with  manuals  that  are 
too  difficult  for  him  to  use.  In  the  SPA  approach  the  fully 
proceduralized  manuals  are  the  primary  resource  for  the 
training  of  equipment  specific  tasks.  All  that  is  required  is 
an  adequate  management  scheme  for  the  use  of  the  man 
uals  in  on-thejob  training  and  some  supplementary  train 
ing  materials  for  tasks  that  are  particularly  difficult. 

Extension  Training  Materials  (ETM) 

ETM  are  extensions  of  the  technical  manual  for  se¬ 
lected  tasks  which  require  instruction  beyond  that  which  is 
presented  in  the  manual. 

Task  Selection.  The  initial  analysis  of  equipment 
which  identifies  the  total  task  list  and  provides  task  de 
tails  is  performed  during  front-end  analysis  that  is  de¬ 
scribed  later  in  this  paper.  During  the  ETM  development 
process  each  task  is  analyzed  with  appropriate  head-book 
trade-off  decisions  made  explicitly.  If  the  task  appears 
straight-forward  with  no  particularly  unique  requirements 
then  the  decision  can  be  made  to  rely  entirely  on  the  pro 
ceduralized  manual  with  no  further  consideration  being 
made  for  training  i.e.,  the  skills  required  to  perform  those 
procedures  are  already  in  the  soldier's  repertoire  (as  a  re 
suit  of  his  formal  training).  Other  tasks  do  require  training 
These  are  generally  of  two  types:  those  which  present  a 
degree  of  learning  difficulty  (e.g.,  difficult  motor,  sensory 
or  judgmental  skills)  and  those  which  require  immediate 
task  proficiency  without  reference  to  the  manual  (e  g.,  op 
erator  tasks  and  emergency  procedures).  The  resulting  task 
list  is  then  screened  to  group  those  which  require  a  com 
mon  skill  e.g.,  use  of  a  special  tool.  These  may  be  com¬ 
bined  or  reduced  in  scope  in  the  lesson  approach. 

Design  and  Development.  The  lesson  and  course  de¬ 
sign  and  development  is  performed  following  the  Interser¬ 
vice  ISD  Model.  Particular  attention  is  given  to  the  devel¬ 
opment  of  standards  that  will  be  explicit  to  both  the  train¬ 
ee  and  his  supervisor  NCO.  Both  process  scoring  and  go/no 
go  end  item  scores  are  utilized  in  the  criterion  referenced 
tests  to  provide  the  maximum  amount  of  feedback  with 
out  tying  the  NCO  down  to  one  individual  for  extensive 
periods  of  time.  Early  validation  trials  are  used  to  deter¬ 
mine  not  only  if  lesson  objectives  are  achieved  but  also  to 
determine  if  field  objectives  can  be  achieved,  i.e.,  the  train¬ 
ing  managers  guide  is  validated  as  well  to  insure  that  equip¬ 
ment  demands  are  reasonable  or  to  determine  if  special 
trainers  are  required. 

ETM  Training  Packages.  A  training  package  is  pre¬ 
pared  for  each  specific  equipment  item.  It  contains  all  of 
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the  instructions  and  materia's  necessary  to  support  a  super- 
viseo  on-the-|ob  training  (SOJT)  program  for  a  particular 
MGS  ano  maintenance  level  Each  ETM  package  contains 
two  oasic  documents,  a  Manager's  Guide  and  a  Student 
Gu'de.  The  Manager's  Guide  provides  the  NCO  with  com¬ 
plete  instructions  and  recordkeeping  aids  to  conduct  the 
program.  The  Student  Guide  provides  general  instructions 
concerning  tnat  ETM  package  and  specific  lesson  applica¬ 
tions  for  the  Soldier,  and  also  includes  pre-tests  and  post¬ 
tests.  Lessons  may  be  in  one  of  three  modes  of  presenta¬ 
tion:  Printed  Text,  Audiovisual  (AV),  or  Audio-only  (AO). 
The  printed  medium  is  the  preferred  method  of  lesson  pre¬ 
sentation  for  reasons  of  botn  economy  and  ease  of  use  in 
the  field.  When  justified  by  training  effectiveness  consider¬ 
ations,  the  other  modes  may  be  used.  The  lessons  are  de¬ 
signed  to  permit  the  student  to  perform  much  of  the  les 
son  by  himself.  The  NCO  is  involved  at  critical  checkpoints 
throughout  the  lesson.  The  checkpoints  are  defined  in  the 
lesson  instructions. 

ETM  Scenario.  The  NCO,  in  concert  with  the  Sol¬ 
dier,  selects  an  ETM  lesson.  This  selection  will  be  based 
upon  unit  and  individual  needs  and  guided  by  the  lesson 
sequence  instructions.  The  NCO  has  the  Soldier  read  and 
become  familiar  with  the  Student  Guide  and  basic  techni¬ 
cal  manual.  The  NCO  then  administers  the  lesson  pre-test 
to  the  Soldier.  If  the  pre-test  is  passed,  the  NCO  annotates 
a  "GO"  in  his  Course  Record  Sheet,  and  the  lesson  selec¬ 
tion  process  is  repeated. 

If  the  pre-test  is  a  failure,  or  "NO-GO",  the  NCO  ad¬ 
ministers  the  lesson  to  the  student.  By  virtue  of  its  design, 
the  NCO  will  not  have  to  be  present  during  the  entire  les 
son,  except  at  those  points  so  stated  in  the  lesson  instruc¬ 
tions.  After  the  Soldier  has  completed  the  lesson,  the  NCO 
administers  the  post  test.  If  the  post-test  is  passed,  the 
NCO  will  indicate  the  "GO"  in  his  Course  Record  Sheet 
and  the  pre  test,  lessons  and  post-test  procedure  is  repeat 
ed  until  the  Soldier  completes  all  of  the  lessons  in  that 
ETM  package.  If  a  post-test  is  failed,  then  the  NCO  will 
administer  remedial  training  according  to  the  lesson,  which 
will  include  any  supplementary  materials  suggested  as  addi¬ 
tional  training  materials. 


pected  to  use  the  materials.  Typical  "products"  include  a 
complete  task  list  which  is  structured  according  to  the  |Ob 
which  is  to  be  performed  i.e.,  operator,  organizational 
maintenance  or  DS/GS  maintenance.  A  tentative  list  is 
made  of  user  prerequisites  such  as  aptitude  scores,  reading 
grade  level,  skills  in  performing  basic  maintenance  proce 
dures  and  basic  knowledge  of  certain  principles  taught  in 
the  formal  school  setting  (such  as  fundamentals  of  elec¬ 
tronics).  Each  individual  task  is  then  described  and  ana 
lyzed  resulting  in  a  collection  of  task  details  shown  in 
Table  1. 


TABLE  1.  Task  Details 


Equipment  Condition 
Tools  and  Test  Equipment 
Preliminary  Tasks 
Hazards 

Task  Standards  (Time,  etc.) 
Environmental  Conditions 
Coordination  Requirer 


Task  Interval 
Hazards  Criticality 
Follow-on  Tasks 
Auxiliary  Equipment 
Supplies  and  Forms 
Major  T ask  Steps 
(verbal,  time,  physical) 


It  should  be  recognized  that  the  above  task  details  are  use¬ 
ful  for  both  the  ETM  and  manuals.  Most  of  this  informa¬ 
tion  will  be  included  in  the  technical  manuals  directly  but 
was  also  necessary  for  training  decisions  and  development 
of  lessons.  In  the  past  such  detailed  analyses  were  con¬ 
ducted  for  training  purposes;  however  once  the  essential 
training  information  was  obtained  the  information  only 
found  its  way  into  training  manuals  and  was  not  used  on 
the  job  or  it  was  discarded  completely.  The  technical 
manual  developers  performed  their  own  development  se¬ 
quence  but  in  an  unstructured  process  that  was  not  usable 
by  training  developers.  The  SPA  approach  eliminates  or  at 
least  greatly  reduces  this  costly  duplication  of  analysis  and, 
more  importantly,  insures  that  all  tasks  are  adequately 
covered  by  either  the  technical  manual,  training  or  both. 
In  the  past  incorrect  assumptions  were  made  by  both  the 
manual  developer  and  the  training  developer  because  re 
sponsibilities  were  assigned  only  at  a  global  level.  These 
responsibilities  are  now  explicitly  stated  at  the  task  level. 


DISCUSSION 


The  NCO  can  now  use  the  Course  Record  Sheet  as  a 
quick  reference  guide  to  identify  those  areas  of  weakness 
for  future  training  needs.  The  Course  Record  Sheet  is  kept 
by  the  NCO  until  the  Soldier  departs  the  unit.  At  that 
lime,  the  record  would  be  transferred  to  the  gaining  unit 
to  certify  the  Soldier's  OJT  progress,  and  equipment 
knowledge. 

Front-End  Analysis 

Regardless  of  "format"  used  the  most  successful  in 
novations  in  technical  manuals  and  training  have  all  been 
based  on  a  comprehensive  analysis  of  the  job  and  individ¬ 
ual  tasks  prior  to  preparation  of  materials.  The  Front-End 
Analysis  used  in  the  SPA  approach  utilizes  a  common  data 
base  for  the  TM's  and  training.  Data  are  collected  relevant 
to  the  equipment  to  be  maintained  and  the  personnel  ex 


The  inherent  power  of  the  SPA  approach  lies  in  its 
total  commitment  to  the  systems  approach.  Each  of  the 
concepts  found  within  the  SPA  program  have  succeeded 
on  their  own  merits;  yet  taken  alone  these  concepts  have 
not  been  used  to  best  advantage  and  have  come  under 
attack  if  for  no  other  reason  than  cost  effectiveness.  Con 
ducting  a  detailed  task  analysis  for  training  purposes,  only 
to  discard  the  information  because  only  principles  training 
can  be  afforded,  is  not  cost  effective.  Developing  fully  pro- 
ceduralized  aids  for  overtrained  individuals  (if  it  were  pos¬ 
sible)  is  likewise  not  cost  effective.  To  rely  on  the  tradi 
tional  on-the-job-training  concept  is  not  effective  for  many 
reasons  as  pointed  out  by  McGehee  and  Thayer  (1961).  No 
diagnostic  measures  are  generally  available,  the  training  can 
be  very  expensive  if  special  materials  and  special  instruc 
tors  have  to  be  provided,  or  the  training  can  be  totally  in 
effective  if  no  materials  are  provided  and  the  trainee 
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"learns  by-doing"  on  very  expensive  equipment  using  trial 
and  error  methods.  It  likewise  places  an  undue  burden  on 
supervisors  to  create  their  own  training  programs  when  the 
maionty  of  them  do  not  possess  the  time  or  proper  train¬ 
ing  jo  create  such  materials.  The  SPA  program  integrates 
these  concepts  and  for  the  first  time  makes  available  a 
supervised  structured  on  the  job  training  program  that  ade¬ 
quately  supports  both  the  soldier  and  his  supervisor  and 
provides  comprehensive  performance  aids  to  insure  that 
proficiency  on  the  job  can  be  maintained. 
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ABSTRACT 

This  paper  first  outlines  the  two  areas  of  training  and  aiding,  which  have  remain¬ 
ed  as  relatively  distinct  entities  for  several  decades.  Problems  generated  by  such  sepa¬ 
ration  are  discussed  such  as  the  development  of  aiding  materials  which  are  so  specific 
that  the  technician  is  left  in  a  dead-end  career  slot,  and  maintenance  simulators  which 
teach  only  hands-on  practice  without  any  form  of  verbal  material  to  tie  the  overall 
task  together.  Finally,  the  possibility  for  merger  in  the  form  of  "Traiding"  is  pro¬ 
posed. 


INTRODUCTION 

The  training  and  aiding  communities  have  been  “sep¬ 
arate  but  equal"  for  so  long  that  many  of  us  have  been 
slow  to  notice  how  closely  intertwined  our  destinies  have 
become.  So  closely,  in  fact,  that  one  day  the  second  au¬ 
thor's  eyes  became  slightly  crossed  from  fatigue,  and  they 
accidentally  conveyed  the  word  "traiding"  to  him;  it 
seemed  so  natural  that  he  didn't  even  slacken  his  pace,  but 
resolved  to  work  this  fortuitously  conceived  concept  into  a 
conference. 

THE  WAY  WE  WERE 

The  functions  of  training  and  aiding  grew  up  (or  at 
ieast  reached  adolescence!  separately,  because  of  an  acci¬ 
dent  of  history:  training  came  first  and  was  firmly  en¬ 
trenched  by  the  time  performance  aiding  matured  enough 
to  oe  considered  "a  technology."  Even  though  many  of 
the  performance-aid  pioneers  and  their  descendants  were 
training  types,  they  had  their  own  rats  to  kill,  and  for  the 
most  part  were  forced  to  design  their  experiments  and 
mold  the  elements  of  their  technology  in  something  of  a 
vacuum. 

Meanwhile,  the  pressures  of  the  "systems  approach" 
led  the  training  community  to  become  heavily  absorbed  in 
development  of  the  principles  of  Instructional  System  De¬ 
velopment  USD).  The  ISD  people  and  the  performance-aid 
people  still  spoke  the  same  language,  and  even  espoused 
roughly  the  same  "front-end  analysis"  approach,  but  when 
n  same  right  to  the  point  of  sitting  down  and  working  to¬ 
gether,  the  closest  we  got  was  the  rather  standoffish  con¬ 


cept  of  "the  head-book  tradeoff."  The  latter  presented  at 
least  a  theoretical  opportunity  for  both  groups  to  partici 
pate  in  the  explicit  allocation  of  tasks  to  training,  docu 
mentation,  both,  or  neither.  But  neither  group  incurred  an 
obligation  to  the  other  to  follow  through  and  make  cer¬ 
tain,  as  the  training  and  aiding  development  continued, 
that  the  combined  final  product  would  be  good,  or  even 
that  it  would  work  at  all. 

It  became  obvious  from  even  the  early  applications  of 
ISD  and  performance  aids  that  there  were  a  number  of  se¬ 
rious  loose  ends  which  had  not  been  addressed  by  the  de¬ 
velopers.  In  all  the  services,  these  loose  ends  seemed  to 
have  devastating  consequences  for  the  implementation  and 
acceptance  of  programs,  as  well  as  for  the  long-range  well¬ 
being  of  job  incumbents.  On  the  training  side,  simulation 
technology  (at  least  for  flight  training)  outstripped  our 
ability  to  figure  out  how  to  use  simulators  effectively,  and 
large,  expensive  devices  were  purchased,  only  to  be  used 
inappropriately  or  not  at  all.  In  this  regard,  maintenance 
training  simulators  have  been  fabricated  which  teach 
hands-on  troubleshooting  skills  in  a  truly  effective  manner, 
however,  without  any  form  of  verbal  presentation  to 
accompany  the  device.  Thus,  the  self-paced  possibilities  of 
the  equipment  are  almost  totally  neutralized 

On  the  publications  end,  self-instructional  material 
was  prepared  in  formats  that  offended  users  and  conse 
quently  fell  into  widespread  disuse.  Inadequately-prepared 
instructors  took  unfamiliar  state-of-the-art  material  and 
converted  it  back  into  the  same  only  stand-up  lecture  drill. 
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And  experimental  students,  taught  how  to  do  complex 
lobs  without  knowing  the  theory  behind  them,  found 
themselves  up  a  career  stump.  There  was  no  upward  career 
path  for  someone  who  could  merely  do  the  job  compe¬ 
tently-  tradition  dictated  that  he  also  be  able  to  pass  ad 
vancement  tests  involving  theoretical  material  not  neces 
sarily  relevant  to  the  job.  The  experimenters  had  not  been 
at  liberty  to  alter  the  advancement  scheme  or  the  career 
structure,  an c  it  became  immediately  and  painfully  appar 
ent  tha:  another  family  of  "moderator  variables"  had  been 
identified. 

Performance-aiding,  insofar  as  it  has  been  developed 
to  date,  has  largely  evolved  as  a  subset  of  publications.  As 
such,  aiding  went  through  all  the  same  mistakes  as  the 
above,  with  all  the  same  consequences.  Improperly  or  in¬ 
completely  introduced  aids  were  resented  and  went  un 
used.  Experienced  maintenance  people  found  some  proce- 
duralized  aids  cumbersome  to  use,  tried  shortcuts,  and 
attributed  lack  of  success  to  the  aids  rather  than  the  short¬ 
cuts.  And  again,  the  entry-level  trainee  for  whom  some  of 
the  "idiot-level"  aids  were  designed  discovered  that  he 
would  be  in  a  dead-end  career  slot  as  long  as  he  was  depen¬ 
dent  upon  the  aids,  because  we  hadn't  even  thought 
through  the  problem  of  what  to  do  with  him  if  he  turned 
out  to  be  career-force  material.  We  tried  to  sell  advanced 
aids  on  the  grounds  that  they  offered  the  chance  to  defer 
expensive  front-end  training  until  later  and  to  get  useful 
work  out  of  people  very  early  in  their  first  enlistments.  We 
demonstrated  the  useful-work-early  feature  but  forgot  to 
design  the  traimng-deferred-to-later  feature,  leaving  exper¬ 
imental  subjects  stranded  in  a  partial-prototype  limbo. 

Although  our  limited  tryouts  in  aiding,  as  well  as 
those  in  simulation  (especially  maintenance),  were  gener¬ 
ally  successful  in  demonstrating  the  particular  phenomena 
under  investigation,  each  time  we  expanded  the  scope  of 
an  experiment,  we  discovered  more  "moderators"  that  we 
had  overlooked  or  failed  to  control.  Having  catalogued 
more  serious  oversights,  we  resolved  to  manage  most  of 
them  more  carefully  when  we  finally  got  our  first  chances 
for  large-scale,  real-world  implementation.  The  stage  was 
finally  set  for  attempts  to  tie  training,  aiding,  and  moder¬ 
ator-wrestling  together  into  a  coherent  approach  to  build¬ 
ing  and  maintaining  competence  on  the  job. 

WE'RE  READY  FOR  TRAIDING 

The  Army's  Integrated  Technical  Documentation  and 
Training  (ITDT)  program  (now  called  Skill  Performance 
Aids  (SPA),  and  discussed  elsewhere  in  this  volume  by 
John  Klesch)  has  had  its  ups  and  downs,  but  it  is  the  first 
really  broadly  applied  attempt  to  control  both  training 
and  aiding  development  centrally,  using  an  ISO-type  ap¬ 
proach.  It  is  ironic  that  although  training  and  aiding  are 
being  developed  centrally  in  SPA,  the  main  thrust  of  the 
program  is  to  de-centralize  technical  training  overall. 

Also  discussed  elsewhere  in  this  volume  (by  Bob 
Blanchard)  is  NPRDC's  new  Integrated  Personnel  System 
Approach  (IPSA)  project.  The  first  author's  bias  is  that 


the  IPS  approach  will  be  somewhat  more  flexible  than 
that  of  the  Army's  SPA  in  terms  of  one's  ability  to  tailor 
the  solution  to  the  problem.  Although  the  IPS  project 
began  in  the  context  of  performance-aid  research,  it  is 
designed  to  arrange  for  control  over  the  entire  personnel 
system,  including  the  design  of  jobs,  and  specification  of  a 
new  occupational  specialty  if  necessary.  If  a  new  career 
structure  spanning  more  than  one  enlistment  is  required, 
detailed  training  and  aiding  plans  are  designed  to  foster  the 
dynamic  shifting  of  the  head-book  tradeoff  across  an  in 
dividual's  enlistment. 

If  the  personnel  pipeline  management  levels  of  IPSA 
at  NPRDC  could  be  married  to  some  of  the  instructional 
delivery  schemes  of  the  Human  Factors  Laboratory,  Naval 
Training  Equipment  Center,  it  is  the  second  author's  bias 
that  a  powerful  combination  could  result.  And  if  this 
could  be  leavened  with  healthy  doses  of  decentralization 
from  Army's  SPA,  perhaps  Traiding  could  really  fly. 

One  point  seems  certain.  Compared  to  the  provincial 
ism  of  the  past,  the  long-term,  dynamic  adaptability  of 
training  and  aiding  to  the  changing  needs  and  capabilities 
of  the  technician  is  probably  the  most  important  feature 
that  a  new  Traiding  concept  should  have.  Many  opera¬ 
tional  environments  have  job  slots  for  people  of  more  than 
a  single  skill  level  within  a  given  specialty,  implying  that 
someone  in  there  is  not  yet  a  journeyman,  and  that  we  ex¬ 
pect  him  somehow  to  increase  in  competence  as  he  ma¬ 
tures  in  his  job.  We  have  traditionally  treated  both  training 
and  aiding  as  stationary  targets,  and  have  made  assump¬ 
tions  that  resulted  in  our  taking  a  single,  very  large  shot  at 
the  front  end.  Traiding  must  recognize  that  the  technician 
will  evolve  (whether  we  wish  it  or  not)  into  a  slightly  dif¬ 
ferent  target  every  day  throughout  his  enlistment,  and  that 
evolution  rates  and  asymptotes  will  vary  across  individuals. 
It's  a  bit  like  tumbling  rocks  in  order  to  polish  them.  If 
you  just  want  to  knock  the  rough  edges  off,  you  can  use  a 
pretty  coarse  polishing  compound.  But,  if  you  want  to 
bring  each  piece  to  a  high  polish  while  allowing  it  to  retain 
its  own  unique  shape,  you  have  to  commit  yourself  to 
using  a  carefully  planned  sequence  of  compounds  that 
differ  from  each  other  both  in  coarseness  and  in  com¬ 
position. 

WHAT  DOES  THE  'TRAIDER"  DO? 

The  Traiding  approach  will  ultimately  have  to  provide 
a  catalog  of  polishing  compounds  so  that  program  man¬ 
agers  (Traiders)  can  choose  an  acceptable  match  between 
their  pocketbooks  and  the  size  of  the  odd  shaped  nooks 
and  crannies  that  they  want  to  polish.  We  may  even  have 
SPA,  IPS,  JPA,  ISD,  simulator  design,  and  job  design 
specifications  to  comfort  the  program  manager  who  wants 
to  build  state-of-the-art  maintenance  performance  and  job 
satisfaction.  But  there  is  one  more  important  ingredient 
missing:  guidance  in  how  to  be  the  ideal  program  man¬ 
ager.  We've  all  seen  (and  some  of  us  may  have  helped  to 
create)  the  problems  faced  by  a  program  manager  as  he 
tries  to  juggle  the  components  of  a  system.  The  T raider 
will,  if  he  survives,  have  to  develop  a  manager's  handbook 
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tha;  would  include  chapters  on  how  to  avoid  the  influence 
of  lobbyists,  how  to  get  the  wnole  team  working  together 
(possibly  by  having  some  of  the  training  developed  by  the 
tech  data  people  and  some  of  the  tech  data  developed  by 
the  training  people),  how  to  be  sure  the  products  are  com 
plete  and  accurate,  how  to  implement  the  whole  thing  in 
such  a  way  that  it  will  be  used  as  intended,  how  to  be  sure 
new  concepts  of  training  devices,  simulators  and  other 
media  are  used  in  an  effective  way,  and  how  to  evaluate 
tne  new  system  to  be  sure  it  is  providing  the  intended 
results. 

The  ISO  process  has  been  around  long  enough  to 
demonstrate  to  most  of  us  that  including  it  (ISD)  in  a 
program  spec  doesn't  ensure  that  its  spirit  will  be  reflected 
m  the  final  system.  If  the  program  manager  can  be  buf¬ 
faloed  by  contractors,  members  of  his  own  team,  or  the 
training  establishment,  some  of  them  will  probably  try  to 
cut  a  few  corners,  quite  possibly  subverting  much  of  the 
iSD  philosophy  in  the  process.  The  successful  Traider 
will  need  an  unfailing  combination  of  clear  guidance, 
measurable  criteria,  and  stern  resolve  to  keep  all  of  the 
elements  communicating  with  each  other,  and  meeting 
those  criteria. 


Or.  William  J.  King 

Dr.  King,  a  former  Remote  Control  System  Techni 
cian  in  the  U.S.  Marine  Corps,  obtained  the  B.A.  degree  in 
Psychology  from  the  State  University  of  Iowa,  the  M.A.  in 
Experimental  Psychology  from  the  University  of  Illinois, 
and  the  Ph.D.  in  Experimental  Psychology  from  the  Uni 
versity  of  Sydney,  N.S.W.,  Australia.  In  the  Human  Fac¬ 
tors  field  for  over  twenty  years.  Dr.  King  has  worked  with 
the  man-machine  problems  of  many  types  of  military  vehi¬ 
cles  such  as  submarines,  conventional  aircraft,  helicopters, 
and  space  vehicles.  He  has  authored  a  number  of  Technical 
Reports  and  publications,  and  is  now  employed  as  an  Engi 
neering  Psychologist  in  the  Human  Factors  Laboratory, 
Naval  Training  Equipment  Center,  Orlando,  Florida. 


LET'S  TRAID 

Some  of  the  participants  of  this  conference  have 
assembled  for  similar  reasons  in  recent  years,  and  each 
time,  they  have  brought  along  increasingly  fine-tuned 
training  and  aiding  concepts  and  techniques,  and  increasing 
awareness  of  the  real-world  concomitants  of  Traiding  as  we 
mean  it  here.  We  are  finally  engaged  in  some  extensive, 
ambitious  projects  that  can  reasonably  be  thought  of  as 
prototype  Traiding  projects.  The  lessons  that  we  stand  to 
learn  about  implementation  of  Traiding  should  put  us  in  a 
strong  position  to  move  ahead  with  a  DOD-wide  program 
of  improved  and  workable  maintenance  training  and 
aiding. 
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aids,  and  several  handbooks  for  performance-aid  devel¬ 
opers  and  Air  Force  program  managers. 

He  is  currently  directing  a  study  of  on-the  job  infor¬ 
mation-seeking  behavior  by  Army  maintenance  techni¬ 
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THE  AUTOMATED  INTEGRATION  OF  TRAINING  AND  AIDING 
INFORMATION  FOR  THE  OPERATOR/TECHNICIAN 


Dr.  Dougin  M.  Towne 
Director 

Behavioral  Technology  Laboratories 
University  of  Southern  California 
Los  Angeles,  California 


ABSTRACT 

A  responsive  and  intelligent  device  which  can  provide  both  training  information 
and  job  performance  aiding  can  be  extremely  efficient  in  utilization  of  hardware,  soft¬ 
ware,  and  so-called  course  ware.  The  hardware  components  useful  for  presenting  auto¬ 
mated  instruction  are  essentially  the  same  as  those  required  to  aid  an  operator  or 
technician,  viz.,  a  versatile  and  fast  microprocessor  CPU,  ample  random  access  mem¬ 
ory.  ample  bulk  storage,  and  appropriate  input-output  media.  While  the  software 
driving  such  a  device  may  be  a  collection  of  relatively  special-purpose  routines  design¬ 
ed  to  satisfy  particular  training  or  aiding  needs,  a  large  portion  of  this  software  may 
be  common  utility  functions  which  respond  to  specific  requests  of  the  user  or  serve  to 
manipulate  data  about  the  target  equipment  or  data  about  the  operator/technician. 
Finally,  the  data  base  which  characterizes  a  target  equipment  can  be  designed  in  such 
a  way  that  both  training  and  aiding  requirements  are  met  without  duplication  or  in¬ 
efficiency  of  preparation  effort. 

Under  a  contract  with  Naval  Training  Equipment  Center,  Behavioral  Technology 
Laboratories  has  assembled  the  hardware  elements  of  such  a  system,  designed  the  data 
base  structure  for  characterizing  a  specific  target  equipment,  and  programmed  rou¬ 
tines  for  training  novice  operator/technicians  and  aiding  equipment  operation  and 
maintenance. 


BACKGROUND 

There  has  been  much  discussion  and  disagreement 
over  the  years  regarding  which  requirements  for  technician 
proficiency  are  most  appropriately  trained  and  which  are 
better  provided  via  external  job  performance  aids.  It  ap¬ 
pears  that  no  static  and  definitive  assignment  process  is 
forthcoming,  for  the  environment  is  complex,  rapidly 
changing,  and  difficult  to  specify.  These  harsh  realities  do 
not  diminish  the  need  for  the  curriculum  designer  to  make 
rational  choices  in  determining  what  components  of  per¬ 
formance  critically  require  training.  They  do,  however, 
create  a  need  for  a  technique  to  deliver  appropriate  assis¬ 
tance  to  the  maintenance  technician  at  the  job-site  and  to 
provide  additional  training  to  that  technician  so  that  his 
future  dependency  upon  the  support  system  is  reduced. 

Such  a  technique  is  especially  attractive  if  the  re 
sources  required  to  deliver  job  support  are  essentially  iden¬ 
tical  to  those  required  to  provide  training.  This  Labora¬ 
tory,  under  contract  to  Naval  Training  Equipment  Center, 


has  been  developing  a  computer-controlled  trainer/simu 
lator/job  support  system,  with  an  emphasis  on  utilizing 
common  hardware,  programs  and  data  base  to  meet  needs 
ranging  from  OJT  to  detailed  job  performance  assistance. 

The  system,  called  AIDE  (Automated  Instruction, 
Direction  and  Exercise),  is  controlled  by  a  general-purpose 
monitor  program  which  extracts  and  combines  informa 
tion  from  a  data  base  containing  specific  content.  The 
monitor  and  data  base  structure  share  generic  maintenance 
concepts,  such  as  controls,  indicators,  malfunctions,  func 
tions,  symptoms,  etc.  A  new  target  equipment  can  be  im¬ 
plemented  on  AIDE  by  preparing  an  appropriately  format¬ 
ted  listing  of  control  names,  settings,  indicator  names, 
possible  symptoms,  functions,  malfunctions  and  so  on, 
plus  a  set  of  graphic  aids. 

AIDE,  therefore,  consists  of  hardware  to  process  data 
and  interact  with  the  maintenance  technician,  a  computer 
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program,  and  a  representation  of  the  target  equipment,  the 
first  two  of  which  remain  fixed  over  different  applications. 

OBJECTIVES 


via  external  aids.  A  majo r  goal  of  a  training/aiding  system, 
then,  is  to  determine  where  a  particular  technician  stands 
on  this  continuum,  shown  in  Figure  1  (Rtgney,  1976)  and 
to  supply  the  appropriate  job  assistance. 


Tne  primary  objectives  of  our  work  have  been  to 

1)  assemble  the  hardware  elements  necessary  to  deliver 
various  configurations  of  OJT  and  JPA,  2)  formulate  a 
data  base  structrue  which  can  be  "filled"  by  a  technician 
who  is  an  expert  only  In  the  maintenance  of  a  particular 
system  or  device,  3)  design  a  complete  computer  program 
which  can  interact  intelligently  with  a  technician  to  satisfy 
a  wide  range  of  needs,  and  4)  implement  the  designed  rou¬ 
tines.  along  with  a  sample  data  base,  to  test  and  demon¬ 
strate  the  capabilities  achieved. 

The  program  design  includes  provisions  for  adapting 
to  an  individual's  level  of  proficiency  and  experience.  This 
becomes  quite  efficient,  in  fact,  in  a  combined  OJT/JPA 
system  since  many  of  the  technician's  training  require¬ 
ments  can  be  detected  when  he  requests  assistance  during 
performance  of  a  job  task.  Conversely,  the  job  support  of¬ 
fered  can  be  more  easily  tailored  to  the  individual's  needs 
when  the  assisting  system  is  the  one  which  provided  the 
training  to  that  individual. 


too 


Percent 

lntern»l 

Mediation 


0 


FIGURE  1.  External  Facilitation  vs.  Internal  Mediation 


Table  1  presents  a  summary  of  the  types  of  require¬ 
ments  for  JPA  and  OJT  which  AIDE  addresses  and  the 
variations  in  technician  familiarity  which  are  accommo¬ 
dated.  It  is  emphasized,  however,  that  the  user  may  access 
any  of  the  available  support  or  training  capabilities,  regard 
less  of  his  proficiency,  if  he  so  requests. 


It  is  difficult  to  characterize  the  instructional  ap¬ 
proach  employed  during  the  instructional  phases  in  terms 
of  any  one  well-known  technique.  AIDE  acts  somewhat 
Socratic  (Collins,  1976)  in  the  sense  of  responding  to  user- 
initiated  requests.  It  also  is  heavily  oriented  to  what 
Norman  terms  web  learning  (Norman,  1976),  i.e.,  initially 
providing  a  gross,  fundamental  structure  of  knowledge 
about  a  topic  which  is  successively  elaborated  with  increas¬ 
ing  detail  and  wealth  of  information.  For  performance  aid¬ 
ing  the  system  functions  primarily  as  an  information  re¬ 
trieval  system,  with  the  advantage  that  both  data  base 
structure  and  retrieval  functions  are  consistent  from  one 
application  to  the  next,  and  are  not  the  responsibility  of 
the  content  expert  implementing  a  new  subject  equipment. 
Thus  "generative"  approach  (Rigney  and  Towne,  1974) 
allows  the  content  expert  to  concentrate  on  describing  the 
target  system,  without  being  required  to  also  formulate 
student-computer  dialogue,  instructional  schemes,  etc. 

OJT -JPA  CONTINUUM 

We  recognize  that  few  performance  requirements  will 
always  be  satisfied  via  training,  or  always  by  performance 
aiding.  Further,  it  appears  that  "pure"  (exclusive)  training 
and  "pure"  performance  aiding  are  rare  occurrences;  most 
training  experiences  involve  some  degree  of  job  support, 
and  most  supported  performances  rely  on  some  degree  of 
previous  training.  Thus  the  appropriate  level  of  training 
and  job  support  to  provide  a  technician  becomes  knowable 
only  when  a  particular  technician  is  to  maintain  a  partic¬ 
ular  equipment  or  system,  in  some  defined,  and  probably 
somewhat  unique,  environment. 

Obviously,  as  a  technician  receives  increasing  training 
he  is  able  to  independently  generate  more  of  the  required 
actions  and  decisions  which  would  otherwise  be  supplied 


AIDE  HARDWARE 

The  major  hardware  elements  of  AIDE  are  as  follows: 

1)  a  small  computer  (microprocessor  CPU  random 
access  memory  and  mass  disc  storage) 

2)  a  9-inch  CRT :  displays  words,  lists,  names,  etc. 

3)  a  micrographics  unit;  displays  color  photographs 
under  computer  control  -  can  be  either  35mm 
random  slide  projector  or  color  microfiche  unit. 

4)  a  sonic  touch-pen:  for  user  inputs 

5)  a  small  hard-copy  printer 

6)  a  voice  synthesizing  device. 

Figure  2  is  a  view  of  AIDE  as  seen  by  the  user.  The 
command  memu  is  simply  a  removable  card  labelled  with 
the  commands  to  which  AIDE  will  respond  when  touched 
by  the  sonic  pen.  These  commands  allow  the  user  to: 

1)  Select  mode  of  interaction  (assistance,  instruc¬ 
tion,  drill) 

2)  Obtain  any  available  information  about  the  pur¬ 
pose,  theory  of  operation,  or  location  of  a  sec 
tion  of  the  equipment 

3)  View  either  a  photograph  or  functional  diagram 
of  a  section 

4)  Exit  AIDE. 
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TABLE  1.  Requirements  for  JPA  and  OJT  Management 


FIGURE  2  AIDE  System,  Front  View 
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The  :■  i d i o r - ry  of  user  inputs  and  responses  are  made 
pv  touching  the  sonic  pens  to  individual  items  listed  on  the 
CRT  or  to  particular  portions  of  the  hardware  displayed 
on  the  micrographic  screen.  As  described  below  this  allows 
tne  technician  to,  in  effect,  operate,  disassemble,  and  inter¬ 
rogate  the  simulated  equipment,  and  to  interact  with 
AIDE  regarding  what  he  needs. 

Table  3  provides  further  detail  reqarding  the  hard¬ 
ware  components  each  of  which  is  commercially  available 
off-the  shelf.  This  configuration  was  assembled  to  expedite 
development  of  the  concept  while  avoiding  costly  and  time 
consuming  hardware  integration.  As  expected,  a  number  of 
small  commercially-engineered  systems  have  come  on  the 
market  which  contain  the  first  five  components  shown  in 
Table  3  (Small  Systems  World,  1978). 

TRAINING  and  aiding  capabilities 

The  fixed  AIDE  monitor  program  processes  all  inputs 
by  the  user,  retrieves  or  computes  appropriate  responses, 
and  presents  the  responses  on  the  CRT,  on  the  graphics 
screen,  and  in  some  cases  via  the  voice  generator. 


The  three  basic  modes  of  operation  provided  are: 

1 )  job  assistance 

2)  instruction 

3)  drill  and  exercise 

Each  of  these  three  modes  is  available  for  each  of  three 
general  topics: 

1)  equipment  configuration 

2)  equipment  set-ups  (operating  and  maintenance) 

3)  troubleshooting 

The  nine  resulting  types  of  student-AIDE  interactions  are 
produced  from  the  single  bank  of  information  and  graphic 
representations,  utilizing  routines  which  perform  such 
functions  as: 


COMPONENT 

MODEL 

OPERATING  CHAR. 
OR  CAPACITY 

COMMENT  J 

■ 

1 

CPU 

Zilog  Z-80 

8-Bit  Processor, 

4.0  mhz 

158  Instructions  with 

4 , 8-.  16-bit 
operations 

2 

RAM 

Zilog  RMB 

32K  Bytes 

Disk 

Shuggart 

800  Floppy 

300K  Bytes 

77  Tracks/Disk 

32  Hard  sectors  per  track 

128  Bytes  per  sector 

■ 

Alpha¬ 

numeric 

Display 

Sanyo  Raster- 
Scan  CRT 

16  lines 

64  char/line 

9-inch  diagonal  screen 

Hard  copy 
output 

Bowmar 

Printer 

18  char/line 

6 

Graphic 

Display 

Bruning  95 
Microfiche 

30  fiche 

60  images/fiche 

1-sec.  access  on  same 
fiche 

3-sec.  access  to  new 
fiche 

■ 

Audio 

Output 

Federal  Screw 
Works 

VOTRAX 

60-phoneme 

repertoire 

Inflection  also  con¬ 
trolled 

B 

Pointing 

Input 

SAC  Graf-Pen 
NT  201 

.01  inch  reso¬ 
lution 

Can  sense  36"  x  48"  area; 
does  sense  CRT,  Micro¬ 
graphics  screen,  and 
command  menu. 

TABLE  3.  Hardware  Components 
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1)  present  a  picture  ot  sub-element  X 

2)  present  text  which  explains  the  purpose  of  X 

3)  present  a  functional  diagram  of  X 

4)  present  a  picture  which  shows  where  X  is  lo¬ 
cated 

5)  determine  wnat  part  of  X  the  user  just  touched 
with  the  pen 

61  display  a  listing  of  switch  settings  for  mode  M 

7)  show  the  front  panel  set-up  in  mode  M 

8)  show  indicator  I  reading  normal 
Equipment  Configuration 

The  most  fundamental  topic  addressed  by  AIDE  is 
equipment  configuration,  which  concerns  the  abilities  to 

1)  locate  and  identify  physical  elements  in  an  equipment 
or  system,  and  2)  understand  the  functions  of  the  ele¬ 
ments. 

Instruction.  A  technician  who  wishes  to  become  fa¬ 
miliar  with  a  new  equipment  or  system  would  begin  by 
entering  the  instruction  mode,  whereupon  he  would  Ob¬ 
serve  an  image  of  the  total  hardware  configuration.  For  a 
large  svstem  this  image  might  be  a  simplified  line  drawing 
showing  enfre  equipments  as  sub-units.  AIDE  would  pre¬ 
sent  whatever  text  is  available  to  explain  the  purpose,  op¬ 
eration,  and  functional  organization  of  this  entity.  Next, 
each  major  sub-unit  would  be  similarly  shown  and  explain¬ 
ed,  all  at  the  technician's  pace. 

Upon  completing  study  of  this  fixed-sequence  presen¬ 
tation,  the  technician  may  freely  explore  the  physical  sys¬ 
tem  by  selecting  sub-elements  of  particular  interest  (with 
the  touch  pen)  and  reviewing  whatever  associated  text  and 
graphic  aids  he  wishes.  It  is  expected  that  some  motivation 
will  exist  for  pursuing  this  self-controlled  study  since  the 
drill  phase  will  require  that  the  technician  locate  and  iden¬ 
tify  these  elements. 

The  sequence  of  drawings  and  photographs  shown  be¬ 
low  provides  some  indication  of  how  the  technician  can 
"zoom-in"  from  the  initial  overall  photograph  or  drawing, 
to  very  detailed  photographs  of  small  sub-elements. 

When  the  technician  completes  his  exploration, 
study,  and  review  of  the  physical  system  he  progresses  to  a 
similar  instructional  phase  related  to  functional  organiza¬ 
tion.  Then,  instead  of  viewing  photographs  of  hardware 
elements  he  studies  functional  diagrams.  As  before  he  pro 
gresses  to  increasingly  more  detailed  diagrams  by  use  of 
the  touch  pen 

Drill,  Following  the  instructional  phase,  AIDE  drills 
the  technician  in  locating  all  physical  and  functional  sub¬ 
elements  in  the  system  being  studied.  All  interactions  are 
built  into  the  fixed  AIDE  monitor  program  such  that  the 


content  expert  who  prepares  the  data  base  need  be  con 
cerned  only  with  describing  the  structure  and  operation 
of  a  unit  in  the  required  format. 

Assistance.  The  current  program  requires  the  techm 
cian  to  search  for  a  picture  which  identifies  the  location 
of  a  sub-unit.  A  planned  routine  to  alphabetize  the  sub 
element  names,  display  those  on  the  CRT,  and  then  show 
the  image  which  shows  the  location  of  the  selected  unit 
has  not  yet  been  developed. 

Equipment  Set-Up 

The  data  base  contains  the  names  of  the  operational 
and  maintenance  modes,  their  required  control  settings, 
and  images  of  the  appropriate  front  panels,  in  each  state 
(these  may  include  test  equipment  set-ups). 

Instruction  and  Assistance.  AIDE  instructs  and  assists 
by  listing  required  settings  on  the  CRT  and  presenting 
images  of  the  front  panel  properly  set  up,  for  each  mode. 

Drill,  During  drill,  the  technician  is  required  to  "set" 
the  controls  by  touching  the  pen  to  the  proper  settings.  As 
the  pen  touches  a  setting  mark  or  label  a  new  image  is  pro 
jected  showing  the  switch  set  to  the  new  setting.  After  the 
technician  completes  his  set-up  AIDE  evaluates  his  work, 
indicates  errors,  and  requires  that  corrections  be  made. 

Troubleshooting 

Assistance.  The  routines  for  assisting  troubleshooting 
operate  in  cooperation  with  the  technician  to  locate  a  mal 
function.  In  the  fully-supported  condition  AIDE  provides 
all  directions,  which  the  technician  carries  out  on  his  failed 
equipment.  In  less  fully  reported  conditions,  the  techni 
cian  requests  particular  advice.  The  assistance  which  is 
available  consists  of: 

1 )  recommended  next  test  to  perform 

2)  displayed  explanations  of  how  to  perform  the 
test  (if  available  in  the  data  base) 

3)  interpretation  of  the  implications  of  the  symp¬ 
tom  in  terms  of  the  fault  areas  confirmed  or  sus¬ 
pected. 

The  above  cycle  is  repeated  until  the  process  termin¬ 
ates  at  some,  hopefully  small,  fault  area.  As  with  virtually 
all  troubleshooting  aias,  this  type  of  interaction  will  be 
sensitive  to  technician  errors,  and  to  "nasty"  faults  (such 
as  multiple  failures)  which  are  not  accurately  isolated  by 
the  scheme  provided.  The  likelihood  of  technician  errors 
is  reduced  somewhat,  however,  since  he  "reports"  the 
symptom  by  identifying  a  pictorial  image  which  matches 
the  observed  symptom.  And,  since  AIDE  interprets  each 
new  symptom  in  terms  of  the  elements  which  are  sus 
pected  or  eliminated  from  suspicion,  the  technician  can 
gain  insights  into  the  hardware-symptom  relationships  even 
when  the  interactive  process  does  not  succeed 

Instruction  and  Drill.  As  noted  above,  a  technician 
may  find  that  working  real  or  imagined  troubleshooting 
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Projected  Image 


Comment 


Touching  Front  View  would  produce  a  full  color  close  up 
of  the  front  panel,  each  section  of  which  may  be  selected 
and  'operated'  (described  later). 

The  technician  wishes  to  see  behind  the  front  panel  he 
touches  BACK,  BOTTOM  and  receives  e  photograph  of 
the  interior  (not  shown  here).  He  touches  the  labei.  Cur¬ 
sor  Origin  Joystick,  and  sees  image  e. 


Since  there  are  no  symbols  on  image  e,  the  techr-i 
Cian  can  go  no  deeper  .nto  the  joystick  mechanism,  I  j 
He  touches  'UP'  on  the  command  menu  and  again  sees 
the  interior  view.  From  here  he  could  select  any  of  the 
other  sub-elements  or  continue  UP  again  Suppose  he 
wishes  to  look  at  a  circuit  card  he  touches  UP,  sees  m 
age  d,  touches  UP  again,  sees  image  c,  then  touches 
CARD  RACK  and  sees  image  f. 
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Cursor  Ongtn  Joystick,  A20 


( 1 )  He  can,  however,  request  text  which  explains  the  purpose  and  theory  of  operation,  as  well  as  a  functional  diagram 
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CHANGE  1 


Two  additional  images  are  shown,  a  color  photograph  and 
a  labelled  drawing.  If  the  technician  touches  the  over 
board  A2  on  the  labelled  drawing,  he  sees  image  h. 


Three  additional  images  are  view;  a  color  photograph,  a 
part  location  index,  and  a  pin  number  designation  list 
None  of  these  contain  a  ^  thus  no  further  hardware 
detail  is  available  of  the  circuit  board.  Touching  FUNC¬ 
TIONAL  APPEARANCE  on  the  command  menu,  how¬ 
ever,  produces  image  i. 
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Projected  Image 


Comment 


Selecting  any  of  the  three  sub-functions  within  A2  pro¬ 
duces  a  circuit  diagram  at  the  component  level  (not 
shown  here). 

Repeatedly  touching  UP  would  now  move  the  presenta 
tion  to  successively  higher  level  functional  diagrams, 
reaching  the  top  at  image  j. 
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Touching  PHYSICAL  APPEARANCE  on  the  command 
menu  produces  image  a. 


INDICATOR.  OVERALL  FUNCTIONAL  DIAGRAM 


problems  in  the  assistance  mode  does  much  to  reveal  the 
troubleshooting  strategy  of  the  content  expert  and  under¬ 
lying  relationships  between  symptoms  and  functions.  In 
the  instruct  mode  the  technician  is  shown  the  abnormal 
symptoms  produced  by  each  malfunction,  or  fault  area, 
in  the  data  base.  In  the  drill  mode  the  technician  practices 
predicting  the  symptom  at  each  indicator  for  each  fault 
area.  Note  that  the  data  base  does  not  differentiate  con¬ 
ceptually  between  operational  units  in  a  system  and  test 
equipment.  Thus  the  content  expert  may  involve  in  the 
troubleshooting  strategy  as  much  test  equipment  as  might 
be  available  to  the  user. 


DATA  BASE 

Obviously,  if  AIDE  is  to  offer  rich  and  detailed  assis 
tance  and  training  the  data  base  must  be  extensive.  The 
current  data  base,  developed  just  to  test  and  demonstrate 
AIDE,  contains  great  detail  for  just  a  few  areas  of  the 
radar  repeater,  it  contains  just  a  few  of  the  possible  set¬ 
ups,  and  offers  troubleshooting  intelligence  in  a  small  por 
tion  of  the  equipment.  This  data  base  contains  125  images, 
approximately  50  of  which  were  taken  directly  from  exist 
ing  technical  manuals.  It  is  estimated  that  a  complete,  de 
tailed  AIDE  data  base  for  the  AN/SPA-66  would  involve 
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approximately  1000  images,  witn  perhaps  one-quarter 
taken  directly  from  the  technical  manual,  one-half  taken 
from  the  actual  equipment,  and  one-quarter  taken  from 
specially  prepared  diagrams  and  text.  Fortunately,  some 
factors  mitigate  the  human  labor  required  to  produce 
such  a  product,  as  follows: 

1)  The  content  expert  is  free  to  greatly  expand 
areas  of  the  equipment  which  are  especially  dif¬ 
ficult  and  put  less  effort  into  other  areas. 

2)  The  content  expert  may  choose  those  AIDE 
capabilities  most  valuable  for  the  intended  use, 
i.e.,  he  may  omit  all  troubleshooting  data,  or 
supply  only  troubleshooting  data. 

3)  The  content  expert  is  only  concerned  with  de¬ 
scribing  the  target  equipment,  he  need  not  de¬ 
vote  effort  to  considerations  of  sequence  of  in¬ 
struction,  test  questions,  remedial  paths,  etc. 

4)  The  majority  of  images  require  little  or  no  prep¬ 
aration;  they  are  of  existing  material  or  the  ac¬ 
tual  equipment. 

The  fact  remains,  of  course,  that  a  substantial  volume 
of  photographic  work  is  involved,  requiring  perhaps  several 
man  months  of  effort.  For  expensive  operational  systems, 
this  cost  would  be  quite  acceptable  compared  to  the  cost 
of  using  either  the  actual  system  or  a  special-purpose  simu¬ 
lator  for  training  purposes. 

Data  Base  Requirements 

The  content-expert  may  decompose  the  equipment 
into  any  units  which  he  feels  are  accurate  and  useful  for 
understanding.  AIDE  requires  a  physical  breakdown,  a 
functional  breakdown,  and  a  cross-reference  between  the 
two. 

A  small  portion  of  the  physical  structure  data  for  the 
AN/SPA-66  radar  repeater  is  shown  in  Figure  3. 

The  content  expert  supplies  a  photograph  [2]  of  each 
element  in  the  physical  hierarchy  and  a  photograph  of 
each  functional  diagram  in  the  functional  hiearachy,  plus 
whatever  pages  of  explanations  concerning  the  purpose 
and  operation  of  these  system  sub-elements  he  desires. 
Note  that  information  supplied  by  the  content  expert  is 
not  designated  specifically  for  assistance,  instruction,  or 
drill.  The  monitor  program  handles  all  retrieval  and  presen¬ 
tation  of  the  supplied  content  according  to  the  require¬ 
ments  of  the  user. 

During  entry  of  the  data  base  the  content  expert 
touches  the  pen  to  each  defined  sub  section  of  each  photo¬ 
graph.  This  produces  X-Y  coordinates  in  the  data  base 
which  allows  the  user  to  step  through  either  hierarchy  by 
touching  the  area  of  interest  on  the  currently  projected 
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FIGURE  3.  A  Portion  of  the  Sample  Data  Base 


image.  AIDE  responds  by  projecting  a  close-up  image  of 
the  sub-section  selected. 

As  mentioned  earlier,  OJT  and  JPA  for  equipment 
operation  and  maintenance  set-ups  is  produced  by  supply¬ 
ing  names  of  controls,  setting  names,  mode  names,  mode 
descriptions  (required  control  settings),  and  photographs 
of  the  panel(s)  in  each  mode. 

Troubleshooting  training  and  aiding  is  generated  by 
AIDE  from  a  troubleshooting  "tree"  which  specifies  a 
detailed,  conditional,  fault-isolation  approach  of  the  con 
tent  expert,  photographs  of  normal  and  abnormal  symp¬ 
toms  for  each  involved  indicator  (including  test  equip¬ 
ment),  and  explanatory  text  to  assist  in  performing  and 
interpreting  tests. 

REFERENCES 

Collins,  A.  Processes  in  Acquiring  Knowledge  (Tech.  Hep. 
No.  3231).  Cambridge:  Bolt  Beranek  and  Newman, 
Inc.,  January  1976. 

Norman,  D.  A.  Studies  of  Learning  and  Self-contained  Ed 
ucational  Systems,  1973-1976  (Tech.  Rep.  No. 
7601).  San  Diego,  University  of  California,  San 
Diego,  Center  for  Human  Information  Processing, 
March  1976. 

Rigney,  J.  W.  and  Towne,  D.  M.  Computer  Aided  Perform 
ance  Training  for  Diagnostic  and  Procedural  Tasks, 
J.  Educational  Technology  Systems,  Vol  2(4),  1974. 

Rigney,  J.  W.  On  Cognitive  Strategies  For  Facilitating  Ac¬ 
quisition,  Retention,  and  Retrieval  in  Training  and 
Education.  (Tech.  Rep.  78),  Los  Angeles,  University 
of  Southern  California,  Behavioral  Technology  Lab¬ 
oratories,  January,  1974. 


121  Currently,  these  are  in  the  form  of  35mm  color  slides.  Color  microfiche  capability  is  being  added. 


12 


NAVTRAEQUIPCEN  IH-327 


Small  Systems  VVoriu,  Computet  m  a  Suitcase,  October 

19787 Pa  37. 

BIOGRAPHICAL  SKETCH 

Dr.  Douglas  M.  Towne  is  the  Director  of  Behavioral 
Technology  Laboratories,  University  of  Southern  Califor¬ 
nia  He  has  been  performing  research  in  the  areas  of  com 
puter-aided  instruction  optimization  and  modelling  of 
troubleshooting  strategies,  and  automated  analysis  of  hu¬ 
man  tasks  for  fourteen  years,  and  has  published  approxi¬ 
mately  thirty  papers  in  these  areas.  A  professional  I  lus- 
trial  Engineer,  Dr.  Towne  has  also  developed  computer- 
based  systems  for  analyzing  manufacturing  methods  and 
performance  times. 


73/71* 


NAVTRAEQUIPCEN  IH-327 


DISTRIBUTION  LIST 

Commanding  Officer  85 

Naval  Training  Equipment  Center 
Orlando,  FL  32813 


Defense  Technical  Information  Center  12 
Cameron  Station 
Alexandria,  VA  22310 


1/2 


